Multispectral lidar system

ABSTRACT

A multispectral lidar system includes a laser configured to emit a pulse of light including a first wavelength, scanner configured to direct the emitted pulse of light in accordance with a scan pattern, a receiver including a first detector and a second detector, and a controller. The first detector is configured to detect the emitted pulse of light scattered by a remote target, and the second detector is configured to detect light scattered or emitted by the remote target and including a second wavelength. The scanner provides, at any point in time, a fixed spatial relationship between the fields of view over which the light with the first wavelength and the second wavelength is received. A controller can determine a distance to the remote target and use this distance to modify a measurement of the property of the remote target based on the light detected by the second detector.

CROSS-REFERENCE TO RELATED APPLICATION

This application claims priority to provisional U.S. Application Ser.No. 62/480,349, filed on Mar. 31, 2017, entitled “Improving Operation ofa Lidar System,” the entire disclosure of which is hereby expresslyincorporated by reference herein.

FIELD OF TECHNOLOGY

This disclosure generally relates to lidar systems and, moreparticularly, a lidar system that uses optical signals including acertain wavelength to adjust measurements of optical signals includingother wavelengths.

BACKGROUND

The background description provided herein is for the purpose ofgenerally presenting the context of the disclosure. Work of thepresently named inventors, to the extent it is described in thisbackground section, as well as aspects of the description that may nototherwise qualify as prior art at the time of filing, are neitherexpressly nor impliedly admitted as prior art against the presentdisclosure.

Light detection and ranging (lidar) is a technology that can be used tomeasure distances to remote targets. Typically, a lidar system includesa light source and an optical receiver. The light source can be, forexample, a laser which emits light having a particular operatingwavelength. The operating wavelength of a lidar system may lie, forexample, in the infrared, visible, or ultraviolet portions of theelectromagnetic spectrum. The light source emits light toward a targetwhich then scatters the light. Some of the scattered light is receivedback at the receiver. The system determines the distance to the targetbased on one or more characteristics associated with the returned light.For example, the system may determine the distance to the target basedon the time of flight of a returned light pulse.

SUMMARY

One example embodiment of the techniques of this disclosure is amultispectral lidar system comprising a laser configured to emit a pulseof light including a first wavelength, a scanner configured to directthe emitted pulse of light in accordance with a scan pattern, a receiverincluding a first detector and a second detector, and a controller. Thefirst detector is configured to detect, over a first angular regiondefining a first detector field of view (FOV), the emitted pulse oflight scattered by a remote target. The second detector is configured todetect, over a second angular region defining a second detector FOV,light scattered or emitted by the remote target and including a secondwavelength. The scanner provides, at any point in time, a fixed spatialrelationship between the first detector FOV and the second detector FOV.The controller is configured to (i) determine a distance to the remotetarget using the light detected by the first detector, (ii) generate ameasurement of a property of the remote target based on the lightdetected by the second detector, and (iii) modify the generatedmeasurement of the property of the remote target using the determineddistance to the remote target.

Another example embodiment of the techniques of this disclosure is amethod in a multispectral lidar system for multispectral scanning. Themethod comprises emitting a pulse of light including a first wavelength;detecting the emitted pulse of light pulse of light scattered by aremote target; over a first angular region defining a first field ofview (FOV); detecting light scattered or emitted by the remote targetand including a second wavelength, over a second angular region defininga second FOV, where the first FOV and the second FOV have a fixedspatial relationship in accordance with the scan pattern; determining adistance to the remote target using the light detected over the firstFOV; generating a measurement of a property of the remote target basedon the light detected over the second FOV; and modifying the generatedmeasurement of the property of the remote target using the determineddistance to the remote target.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of an example light detection and ranging(lidar) system in which the techniques of this disclosure can beimplemented;

FIG. 2 illustrates in more detail several components that can operate inthe system of FIG. 1;

FIG. 3 illustrates an example configuration in which the components ofFIG. 1 scan a 360-degree field of regard through a window in a rotatinghousing;

FIG. 4 illustrates another configuration in which the components of FIG.1 scan a 360-degree field of regard through a substantially transparentstationary housing;

FIG. 5 illustrates an example scan pattern which the lidar system ofFIG. 1 can produce when identifying targets within a field of regard;

FIG. 6 illustrates an example scan pattern which the lidar system ofFIG. 1 can produce when identifying targets within a field of regardusing multiple beams;

FIG. 7 schematically illustrates fields of view (FOVs) of a light sourceand a detector that can operate in the lidar system of FIG. 1;

FIG. 8 illustrates an example configuration of the lidar system of FIG.1 or another suitable lidar system, in which a laser is disposed awayfrom sensor components;

FIG. 9 illustrates an example vehicle in which the lidar system of FIG.1 can operate;

FIG. 10 illustrates an example InGaAs avalanche photodiode which canoperate in the lidar system of FIG. 1;

FIG. 11 illustrates an example photodiode coupled to a pulse-detectioncircuit, which can operate in the lidar system of FIG. 1;

FIG. 12 illustrates an example multispectral lidar system;

FIG. 13A-D illustrate example implementations of a receiver that canoperate in the system of FIG. 12;

FIG. 14 is a flow diagram of an example method for collectingmultispectral information, which can be implemented in the multispectrallidar system of FIG. 12;

FIG. 15 illustrates an example return pulse that the multispectral lidarsystem of FIG. 12 can process;

FIG. 16 is a flow diagram of an example method for estimating thetemperature of a target, which can be implemented in the multispectrallidar system of FIG. 12; and

FIG. 17 illustrates a detector array that can be used in themultispectral lidar system of FIG. 12 to generate secondary data at ahigher resolution than primary (lidar) data.

DETAILED DESCRIPTION

Overview

A multispectral lidar system includes a scanner to scan atwo-dimensional field of regard to obtain distance-to-target informationat various angles using a laser output beam and a primary detector. Themultispectral lidar system also includes one or more secondary detectorsconfigured to detect optical signals at wavelengths other than thewavelength of the laser used for ranging. The multispectral lidar systemcollects the additional angularly-correlated information using the samescanner that is used for collecting range information. The scanner thusprovides, at any point in time, a fixed spatial relationship between theFOV of the primary detector and the FOV of the secondary detector.

The ranging signal of the lidar can lie in the short-wave infrared(SWIR) portion of the spectrum, while a secondary detector can beconfigured to detect a range of visible wavelengths, or a range ofinfrared wavelengths other than the wavelength used for distanceranging. A range of wavelengths that corresponds to a given detector canbe processed a separate signal. The measurements computed from differentsignals, on the other hand, may be combined in a way that allows onemeasurement to modify another. For example, if the first signal resultsin a measured distance, while the second signal results in a measurementindicative of target size, one may modify the size measurement by thedistance in order to yield a more accurate size measurement.Additionally or alternatively, if the first signal results in a measuredemissivity, while the second signal results in a measurement indicativeof target temperature, a controller can modify the temperaturemeasurement using the detected emissivity to generate a more accuratetemperature measurement.

The one or more secondary detectors can share the optics with theprimary detector used with the ranging signals and lie at differentlocations on the same image plane. In these implementations, eachdetector can have a different field of view from the other detectors atany given time during the scan. In other implementations, differentoptical signals can be separated by filtering optics. In theseimplementations, additional focusing optics can be used to focusdifferent optical signals onto corresponding detectors. In theseimplementations, different optical signals can have overlapping orcoincident fields of view at any given time.

A secondary detector can be configured for passive or active sensing. Inpassive sensing, the secondary detector can collect ambient lightscattered by targets in a scene, or light radiated from the targets. Inactive sensing, a secondary light source can be configured to illuminatethe field of view of the secondary detector. In these implementations,the secondary detector collects light emitted by a secondary lightsource and subsequently scattered by targets within the field of view ofthe detector.

System Overview

FIG. 1 illustrates an example light detection and ranging (lidar) system100. The lidar system 100 may be referred to as a laser ranging system,a laser radar system, a LIDAR system, a lidar sensor, or a laserdetection and ranging (LADAR or ladar) system. The lidar system 100 mayinclude a light source 110, a mirror 115, a scanner 120, a receiver 140,and a controller 150. The light source 110 may be, for example, a laserwhich emits light having a particular operating wavelength in theinfrared, visible, or ultraviolet portions of the electromagneticspectrum. As a more specific example, the light source 110 may include alaser with an operating wavelength between approximately 1.2 μm and 1.7μm.

In operation, the light source 110 emits an output beam of light 125which may be continuous-wave, pulsed, or modulated in any suitablemanner for a given application. The output beam of light 125 is directeddownrange toward a remote target 130 located a distance D from the lidarsystem 100 and at least partially contained within a field of regard ofthe system 100. Depending on the scenario and/or the implementation ofthe lidar system 100, D can be between 1 m and 1 km, for example.

Once the output beam 125 reaches the downrange target 130, the target130 may scatter or, in some cases, reflect at least a portion of lightfrom the output beam 125, and some of the scattered or reflected lightmay return toward the lidar system 100. In the example of FIG. 1, thescattered or reflected light is represented by input beam 135, whichpasses through the scanner 120, which may be referred to as a beamscanner, optical scanner, or laser scanner. The input beam 135 passesthrough the scanner 120 to the mirror 115, which may be referred to asan overlap mirror, superposition mirror, or beam-combiner mirror. Themirror 115 in turn directs the input beam 135 to the receiver 140. Theinput 135 may contain only a relatively small fraction of the light fromthe output beam 125. For example, the ratio of average power, peakpower, or pulse energy of the input beam 135 to average power, peakpower, or pulse energy of the output beam 125 may be approximately 10⁻¹,10⁻², 10⁻³, 10⁻⁴, 10⁻⁵, 10⁻⁶, 10⁻⁷, 10⁻⁸, 10⁻⁹, 10⁻¹⁰, 10⁻¹¹, or 10⁻¹².As another example, if a pulse of the output beam 125 has a pulse energyof 1 microjoule (μJ), then the pulse energy of a corresponding pulse ofthe input beam 135 may have a pulse energy of approximately 10nanojoules (nJ), 1 nJ, 100 picojoules (pJ), 10 pJ, 1 pJ, 100 femtojoules(fJ), 10 fJ, 1 fJ, 100 attojoules (aJ), 10 aJ, or 1 aJ.

The output beam 125 may be referred to as a laser beam, light beam,optical beam, emitted beam, or just beam; and the input beam 135 may bereferred to as a return beam, received beam, return light, receivedlight, input light, scattered light, or reflected light. As used herein,scattered light may refer to light that is scattered or reflected by thetarget 130. The input beam 135 may include light from the output beam125 that is scattered by the target 130, light from the output beam 125that is reflected by the target 130, or a combination of scattered andreflected light from target 130.

The operating wavelength of a lidar system 100 may lie, for example, inthe infrared, visible, or ultraviolet portions of the electromagneticspectrum. The Sun also produces light in these wavelength ranges, andthus sunlight can act as background noise which can obscure signal lightdetected by the lidar system 100. This solar background noise can resultin false-positive detections or can otherwise corrupt measurements ofthe lidar system 100, especially when the receiver 140 includes SPADdetectors (which can be highly sensitive).

Generally speaking, the light from the Sun that passes through theEarth's atmosphere and reaches a terrestrial-based lidar system such asthe system 100 can establish an optical background noise floor for thissystem. Thus, in order for a signal from the lidar system 100 to bedetectable, the signal must rise above the background noise floor. It isgenerally possible to increase the signal-to-noise (SNR) ratio of thelidar system 100 by raising the power level of the output beam 125, butin some situations it may be desirable to keep the power level of theoutput beam 125 relatively low. For example, increasing transmit powerlevels of the output beam 125 can result in the lidar system 100 notbeing eye-safe.

In some implementations, the lidar system 100 operates at one or morewavelengths between approximately 1400 nm and approximately 1600 nm. Forexample, the light source 110 may produce light at approximately 1550nm.

In some implementations, the lidar system 100 operates at frequencies atwhich atmospheric absorption is relatively low. For example, the lidarsystem 100 can operate at wavelengths in the approximate ranges from 980nm to 1110 nm or from 1165 nm to 1400 nm.

In other implementations, the lidar system 100 operates at frequenciesat which atmospheric absorption is high. For example, the lidar system100 can operate at wavelengths in the approximate ranges from 930 nm to980 nm, from 1100 nm to 1165 nm, or from 1400 nm to 1460 nm.

According to some implementations, the lidar system 100 can include aneye-safe laser, or the lidar system 100 can be classified as an eye-safelaser system or laser product. An eye-safe laser, laser system, or laserproduct may refer to a system with an emission wavelength, averagepower, peak power, peak intensity, pulse energy, beam size, beamdivergence, exposure time, or scanned output beam such that emittedlight from the system presents little or no possibility of causingdamage to a person's eyes. For example, the light source 110 or lidarsystem 100 may be classified as a Class 1 laser product (as specified bythe 60825-1 standard of the International Electrotechnical Commission(IEC)) or a Class I laser product (as specified by Title 21, Section1040.10 of the United States Code of Federal Regulations (CFR)) that issafe under all conditions of normal use. In some implementations, thelidar system 100 may be classified as an eye-safe laser product (e.g.,with a Class 1 or Class I classification) configured to operate at anysuitable wavelength between approximately 1400 nm and approximately 2100nm. In some implementations, the light source 110 may include a laserwith an operating wavelength between approximately 1400 nm andapproximately 1600 nm, and the lidar system 100 may be operated in aneye-safe manner. In some implementations, the light source 110 or thelidar system 100 may be an eye-safe laser product that includes ascanned laser with an operating wavelength between approximately 1530 nmand approximately 1560 nm. In some implementations, the lidar system 100may be a Class 1 or Class I laser product that includes a fiber laser orsolid-state laser with an operating wavelength between approximately1400 nm and approximately 1600 nm.

The receiver 140 may receive or detect photons from the input beam 135and generate one or more representative signals. For example, thereceiver 140 may generate an output electrical signal 145 that isrepresentative of the input beam 135. The receiver may send theelectrical signal 145 to the controller 150. Depending on theimplementation, the controller 150 may include one or more processors,an application-specific integrated circuit (ASIC), a field-programmablegate array (FPGA), and/or other suitable circuitry configured to analyzeone or more characteristics of the electrical signal 145 to determineone or more characteristics of the target 130, such as its distancedownrange from the lidar system 100. More particularly, the controller150 may analyze the time of flight or phase modulation for the beam oflight 125 transmitted by the light source 110. If the lidar system 100measures a time of flight of T (e.g., T represents a round-trip time offlight for an emitted pulse of light to travel from the lidar system 100to the target 130 and back to the lidar system 100), then the distance Dfrom the target 130 to the lidar system 100 may be expressed as D=c·T/2,where c is the speed of light (approximately 3.0×10⁸ m/s).

As a more specific example, if the lidar system 100 measures the time offlight to be T=300 ns, then the lidar system 100 can determine thedistance from the target 130 to the lidar system 100 to be approximatelyD=45.0 m. As another example, the lidar system 100 measures the time offlight to be T=1.33 μs and accordingly determines that the distance fromthe target 130 to the lidar system 100 is approximately D=199.5 m. Thedistance D from lidar system 100 to the target 130 may be referred to asa distance, depth, or range of the target 130. As used herein, the speedof light c refers to the speed of light in any suitable medium, such asfor example in air, water, or vacuum. The speed of light in vacuum isapproximately 2.9979×10⁸ m/s, and the speed of light in air (which has arefractive index of approximately 1.0003) is approximately 2.9970×10⁸m/s.

The target 130 may be located a distance D from the lidar system 100that is less than or equal to a maximum range R_(MAX) of the lidarsystem 100. The maximum range R_(MAX) (which also may be referred to asa maximum distance) of a lidar system 100 may correspond to the maximumdistance over which the lidar system 100 is configured to sense oridentify targets that appear in a field of regard of the lidar system100. The maximum range of lidar system 100 may be any suitable distance,such as for example, 25 m, 50 m, 100 m, 200 m, 500 m, or 1 km. As aspecific example, a lidar system with a 200-m maximum range may beconfigured to sense or identify various targets located up to 200 maway. For a lidar system with a 200-m maximum range (R_(MAX)=200 m), thetime of flight corresponding to the maximum range is approximately2·R_(MAX)/c≅1.33 μs.

In some implementations, the light source 110, the scanner 120, and thereceiver 140 may be packaged together within a single housing 155, whichmay be a box, case, or enclosure that holds or contains all or part of alidar system 100. The housing 155 includes a window 157 through whichthe beams 125 and 135 pass. In one example implementation, thelidar-system housing 155 contains the light source 110, the overlapmirror 115, the scanner 120, and the receiver 140 of a lidar system 100.The controller 150 may reside within the same housing 155 as thecomponents 110, 120, and 140, or the controller 150 may reside remotelyfrom the housing.

Moreover, in some implementations, the housing 155 includes multiplelidar sensors, each including a respective scanner and a receiver.Depending on the particular implementation, each of the multiple sensorscan include a separate light source or a common light source. Themultiple sensors can be configured to cover non-overlapping adjacentfields of regard or partially overlapping fields of regard, depending onthe implementation.

The housing 155 may be an airtight or watertight structure that preventswater vapor, liquid water, dirt, dust, or other contaminants fromgetting inside the housing 155. The housing 155 may be filled with a dryor inert gas, such as for example dry air, nitrogen, or argon. Thehousing 155 may include one or more electrical connections for conveyingelectrical power or electrical signals to and/or from the housing.

The window 157 may be made from any suitable substrate material, such asfor example, glass or plastic (e.g., polycarbonate, acrylic,cyclic-olefin polymer, or cyclic-olefin copolymer). The window 157 mayinclude an interior surface (surface A) and an exterior surface (surfaceB), and surface A or surface B may include a dielectric coating havingparticular reflectivity values at particular wavelengths. A dielectriccoating (which may be referred to as a thin-film coating, interferencecoating, or coating) may include one or more thin-film layers ofdielectric materials (e.g., SiO₂, TiO₂, Al₂O₃, Ta₂O₅, MgF₂, LaF₃, orAlF₃) having particular thicknesses (e.g., thickness less than 1 μm) andparticular refractive indices. A dielectric coating may be depositedonto surface A or surface B of the window 157 using any suitabledeposition technique, such as for example, sputtering or electron-beamdeposition.

The dielectric coating may have a high reflectivity at a particularwavelength or a low reflectivity at a particular wavelength. Ahigh-reflectivity (HR) dielectric coating may have any suitablereflectivity value (e.g., a reflectivity greater than or equal to 80%,90%, 95%, or 99%) at any suitable wavelength or combination ofwavelengths. A low-reflectivity dielectric coating (which may bereferred to as an anti-reflection (AR) coating) may have any suitablereflectivity value (e.g., a reflectivity less than or equal to 5%, 2%,1%, 0.5%, or 0.2%) at any suitable wavelength or combination ofwavelengths. In particular embodiments, a dielectric coating may be adichroic coating with a particular combination of high or lowreflectivity values at particular wavelengths. For example, a dichroiccoating may have a reflectivity of less than or equal to 0.5% atapproximately 1550-1560 nm and a reflectivity of greater than or equalto 90% at approximately 800-1500 nm.

In some implementations, surface A or surface B has a dielectric coatingthat is anti-reflecting at an operating wavelength of one or more lightsources 110 contained within enclosure 155. An AR coating on surface Aand surface B may increase the amount of light at an operatingwavelength of light source 110 that is transmitted through the window157. Additionally, an AR coating at an operating wavelength of the lightsource 110 may reduce the amount of incident light from output beam 125that is reflected by the window 157 back into the housing 155. In anexample implementation, each of surface A and surface B has an ARcoating with reflectivity less than 0.5% at an operating wavelength oflight source 110. As an example, if the light source 110 has anoperating wavelength of approximately 1550 nm, then surface A andsurface B may each have an AR coating with a reflectivity that is lessthan 0.5% from approximately 1547 nm to approximately 1553 nm. Inanother implementation, each of surface A and surface B has an ARcoating with reflectivity less than 1% at the operating wavelengths ofthe light source 110. For example, if the housing 155 encloses twosensor heads with respective light sources, the first light source emitspulses at a wavelength of approximately 1535 nm and the second lightsource emits pulses at a wavelength of approximately 1540 nm, thensurface A and surface B may each have an AR coating with reflectivityless than 1% from approximately 1530 nm to approximately 1545 nm.

The window 157 may have an optical transmission that is greater than anysuitable value for one or more wavelengths of one or more light sources110 contained within the housing 155. As an example, the window 157 mayhave an optical transmission of greater than or equal to 70%, 80%, 90%,95%, or 99% at a wavelength of light source 110. In one exampleimplementation, the window 157 can transmit greater than or equal to 95%of light at an operating wavelength of the light source 110. In anotherimplementation, the window 157 transmits greater than or equal to 90% oflight at the operating wavelengths of the light sources enclosed withinthe housing 155.

Surface A or surface B may have a dichroic coating that isanti-reflecting at one or more operating wavelengths of one or morelight sources 110 and high-reflecting at wavelengths away from the oneor more operating wavelengths. For example, surface A may have an ARcoating for an operating wavelength of the light source 110, and surfaceB may have a dichroic coating that is AR at the light-source operatingwavelength and HR for wavelengths away from the operating wavelength. Acoating that is HR for wavelengths away from a light-source operatingwavelength may prevent most incoming light at unwanted wavelengths frombeing transmitted through the window 117. In one implementation, iflight source 110 emits optical pulses with a wavelength of approximately1550 nm, then surface A may have an AR coating with a reflectivity ofless than or equal to 0.5% from approximately 1546 nm to approximately1554 nm. Additionally, surface B may have a dichroic coating that is ARat approximately 1546-1554 nm and HR (e.g., reflectivity of greater thanor equal to 90%) at approximately 800-1500 nm and approximately1580-1700 nm.

Surface B of the window 157 may include a coating that is oleophobic,hydrophobic, or hydrophilic. A coating that is oleophobic (or,lipophobic) may repel oils (e.g., fingerprint oil or other non-polarmaterial) from the exterior surface (surface B) of the window 157. Acoating that is hydrophobic may repel water from the exterior surface.For example, surface B may be coated with a material that is botholeophobic and hydrophobic. A coating that is hydrophilic attracts waterso that water may tend to wet and form a film on the hydrophilic surface(rather than forming beads of water as may occur on a hydrophobicsurface). If surface B has a hydrophilic coating, then water (e.g., fromrain) that lands on surface B may form a film on the surface. Thesurface film of water may result in less distortion, deflection, orocclusion of an output beam 125 than a surface with a non-hydrophiliccoating or a hydrophobic coating.

With continued reference to FIG. 1, the light source 110 may include apulsed laser configured to produce or emit pulses of light with acertain pulse duration. In an example implementation, the pulse durationor pulse width of the pulsed laser is approximately 10 picoseconds (ps)to 100 nanoseconds (ns). In another implementation, the light source 110is a pulsed laser that produces pulses with a pulse duration ofapproximately 1-4 ns. In yet another implementation, the light source110 is a pulsed laser that produces pulses at a pulse repetitionfrequency of approximately 100 kHz to 5 MHz or a pulse period (e.g., atime between consecutive pulses) of approximately 200 ns to 10 μs. Thelight source 110 may have a substantially constant or a variable pulserepetition frequency, depending on the implementation. As an example,the light source 110 may be a pulsed laser that produces pulses at asubstantially constant pulse repetition frequency of approximately 640kHz (e.g., 640,000 pulses per second), corresponding to a pulse periodof approximately 1.56 μs. As another example, the light source 110 mayhave a pulse repetition frequency that can be varied from approximately500 kHz to 3 MHz. As used herein, a pulse of light may be referred to asan optical pulse, a light pulse, or a pulse, and a pulse repetitionfrequency may be referred to as a pulse rate.

In general, the output beam 125 may have any suitable average opticalpower, and the output beam 125 may include optical pulses with anysuitable pulse energy or peak optical power. Some examples of theaverage power of the output beam 125 include the approximate values of 1mW, 10 mW, 100 mW, 1 W, and 10 W. Example values of pulse energy of theoutput beam 125 include the approximate values of 0.1 μJ, 1 μJ, 10 μJ,100 μJ, and 1 mJ. Examples of peak power values of pulses included inthe output beam 125 are the approximate values of 10 W, 100 W, 1 kW, 5kW, 10 kW. An example optical pulse with a duration of 1 ns and a pulseenergy of 1 μJ has a peak power of approximately 1 kW. If the pulserepetition frequency is 500 kHz, then the average power of the outputbeam 125 with 1-μJ pulses is approximately 0.5 W, in this example.

The light source 110 may include a laser diode, such as a Fabry-Perotlaser diode, a quantum well laser, a distributed Bragg reflector (DBR)laser, a distributed feedback (DFB) laser, or a vertical-cavitysurface-emitting laser (VCSEL). The laser diode operating in the lightsource 110 may be an aluminum-gallium-arsenide (AlGaAs) laser diode, anindium-gallium-arsenide (InGaAs) laser diode, or anindium-gallium-arsenide-phosphide (InGaAsP) laser diode, or any othersuitable diode. In some implementations, the light source 110 includes apulsed laser diode with a peak emission wavelength of approximately1400-1600 nm. Further, the light source 110 may include a laser diodethat is current-modulated to produce optical pulses.

In some implementations, the light source 110 includes a pulsed laserdiode followed by one or more optical-amplification stages. For example,the light source 110 may be a fiber-laser module that includes acurrent-modulated laser diode with a peak wavelength of approximately1550 nm, followed by a single-stage or a multi-stage erbium-doped fiberamplifier (EDFA). As another example, the light source 110 may include acontinuous-wave (CW) or quasi-CW laser diode followed by an externaloptical modulator (e.g., an electro-optic modulator), and the output ofthe modulator may be fed into an optical amplifier. In otherimplementations, the light source 110 may include a laser diode whichproduces optical pulses that are not amplified by an optical amplifier.As an example, a laser diode (which may be referred to as a directemitter or a direct-emitter laser diode) may emit optical pulses thatform an output beam 125 that is directed downrange from a lidar system100. In yet other implementations, the light source 110 may include apulsed solid-state laser or a pulsed fiber laser.

In some implementations, the output beam of light 125 emitted by thelight source 110 is a collimated optical beam with any suitable beamdivergence, such as a divergence of approximately 0.1 to 3.0 milliradian(mrad). Divergence of the output beam 125 may refer to an angularmeasure of an increase in beam size (e.g., a beam radius or beamdiameter) as the output beam 125 travels away from the light source 110or the lidar system 100. The output beam 125 may have a substantiallycircular cross section with a beam divergence characterized by a singledivergence value. For example, the output beam 125 with a circular crosssection and a divergence of 1 mrad may have a beam diameter or spot sizeof approximately 10 cm at a distance of 100 m from the lidar system 100.In some implementations, the output beam 125 may be an astigmatic beamor may have a substantially elliptical cross section and may becharacterized by two divergence values. As an example, the output beam125 may have a fast axis and a slow axis, where the fast-axis divergenceis greater than the slow-axis divergence. As another example, the outputbeam 125 may be an astigmatic beam with a fast-axis divergence of 2 mradand a slow-axis divergence of 0.5 mrad.

The output beam of light 125 emitted by light source 110 may beunpolarized or randomly polarized, may have no specific or fixedpolarization (e.g., the polarization may vary with time), or may have aparticular polarization (e.g., the output beam 125 may be linearlypolarized, elliptically polarized, or circularly polarized). As anexample, the light source 110 may produce linearly polarized light, andthe lidar system 100 may include a quarter-wave plate that converts thislinearly polarized light into circularly polarized light. The lidarsystem 100 may transmit the circularly polarized light as the outputbeam 125, and receive the input beam 135, which may be substantially orat least partially circularly polarized in the same manner as the outputbeam 125 (e.g., if the output beam 125 is right-hand circularlypolarized, then the input beam 135 may also be right-hand circularlypolarized). The input beam 135 may pass through the same quarter-waveplate (or a different quarter-wave plate), resulting in the input beam135 being converted to linearly polarized light which is orthogonallypolarized (e.g., polarized at a right angle) with respect to thelinearly polarized light produced by light source 110. As anotherexample, the lidar system 100 may employ polarization-diversitydetection where two polarization components are detected separately. Theoutput beam 125 may be linearly polarized, and the lidar system 100 maysplit the input beam 135 into two polarization components (e.g.,s-polarization and p-polarization) which are detected separately by twophotodiodes (e.g., a balanced photoreceiver that includes twophotodiodes).

With continued reference to FIG. 1, the output beam 125 and input beam135 may be substantially coaxial. In other words, the output beam 125and input beam 135 may at least partially overlap or share a commonpropagation axis, so that the input beam 135 and the output beam 125travel along substantially the same optical path (albeit in oppositedirections). As the lidar system 100 scans the output beam 125 across afield of regard, the input beam 135 may follow along with the outputbeam 125, so that the coaxial relationship between the two beams ismaintained.

The lidar system 100 also may include one or more optical componentsconfigured to condition, shape, filter, modify, steer, or direct theoutput beam 125 and/or the input beam 135. For example, lidar system 100may include one or more lenses, mirrors, filters (e.g., bandpass orinterference filters), beam splitters, polarizers, polarizing beamsplitters, wave plates (e.g., half-wave or quarter-wave plates),diffractive elements, or holographic elements. In some implementations,lidar system 100 includes a telescope, one or more lenses, or one ormore mirrors to expand, focus, or collimate the output beam 125 to adesired beam diameter or divergence. As an example, the lidar system 100may include one or more lenses to focus the input beam 135 onto anactive region of the receiver 140. As another example, the lidar system100 may include one or more flat mirrors or curved mirrors (e.g.,concave, convex, or parabolic mirrors) to steer or focus the output beam125 or the input beam 135. For example, the lidar system 100 may includean off-axis parabolic mirror to focus the input beam 135 onto an activeregion of receiver 140. As illustrated in FIG. 1, the lidar system 100may include the mirror 115, which may be a metallic or dielectricmirror. The mirror 115 may be configured so that the light beam 125passes through the mirror 115. As an example, mirror 115 may include ahole, slot, or aperture through which the output light beam 125 passes.As another example, the mirror 115 may be configured so that at least80% of the output beam 125 passes through the mirror 115 and at least80% of the input beam 135 is reflected by the mirror 115. In someimplementations, the mirror 115 may provide for the output beam 125 andthe input beam 135 to be substantially coaxial, so that the beams 125and 135 travel along substantially the same optical path, in oppositedirections.

Generally speaking, the scanner 120 steers the output beam 125 in one ormore directions downrange. The scanner 120 may include one or morescanning mirrors and one or more actuators driving the mirrors torotate, tilt, pivot, or move the mirrors in an angular manner about oneor more axes, for example. For example, the first mirror of the scannermay scan the output beam 125 along a first direction, and the secondmirror may scan the output beam 125 along a second direction that issubstantially orthogonal to the first direction. Example implementationsof the scanner 120 are discussed in more detail below with reference toFIG. 2.

The scanner 120 may be configured to scan the output beam 125 over a5-degree angular range, 20-degree angular range, 30-degree angularrange, 60-degree angular range, or any other suitable angular range. Forexample, a scanning mirror may be configured to periodically rotate overa 15-degree range, which results in the output beam 125 scanning acrossa 30-degree range (e.g., a 0-degree rotation by a scanning mirrorresults in a 20-degree angular scan of the output beam 125). A field ofregard (FOR) of the lidar system 100 may refer to an area, region, orangular range over which the lidar system 100 may be configured to scanor capture distance information. When the lidar system 100 scans theoutput beam 125 within a 30-degree scanning range, the lidar system 100may be referred to as having a 30-degree angular field of regard. Asanother example, a lidar system 100 with a scanning mirror that rotatesover a 30-degree range may produce the output beam 125 that scans acrossa 60-degree range (e.g., a 60-degree FOR). In various implementations,the lidar system 100 may have a FOR of approximately 10°, 20°, 40°, 60°,120°, or any other suitable FOR. The FOR also may be referred to as ascan region.

The scanner 120 may be configured to scan the output beam 125horizontally and vertically, and the lidar system 100 may have aparticular FOR along the horizontal direction and another particular FORalong the vertical direction. For example, the lidar system 100 may havea horizontal FOR of 10° to 120° and a vertical FOR of 2° to 45°.

The one or more scanning mirrors of the scanner 120 may becommunicatively coupled to the controller 150 which may control thescanning mirror(s) so as to guide the output beam 125 in a desireddirection downrange or along a desired scan pattern. In general, a scanpattern may refer to a pattern or path along which the output beam 125is directed, and also may be referred to as an optical scan pattern,optical scan path, or scan path. As an example, the scanner 120 mayinclude two scanning mirrors configured to scan the output beam 125across a 60° horizontal FOR and a 20° vertical FOR. The two scannermirrors may be controlled to follow a scan path that substantiallycovers the 60°×20° FOR. The lidar system 100 can use the scan path togenerate a point cloud with pixels that substantially cover the 60°×20°FOR. The pixels may be approximately evenly distributed across the60°×20° FOR. Alternately, the pixels may have a particular non-uniformdistribution (e.g., the pixels may be distributed across all or aportion of the 60°×20° FOR, and the pixels may have a higher density inone or more particular regions of the 60°×20° FOR).

In operation, the light source 110 may emit pulses of light which thescanner 120 scans across a FOR of lidar system 100. The target 130 mayscatter one or more of the emitted pulses, and the receiver 140 maydetect at least a portion of the pulses of light scattered by the target130.

The receiver 140 may be referred to as (or may include) a photoreceiver,optical receiver, optical sensor, detector, photodetector, or opticaldetector. The receiver 140 in some implementations receives or detectsat least a portion of the input beam 135 and produces an electricalsignal that corresponds to the input beam 135. For example, if the inputbeam 135 includes an optical pulse, then the receiver 140 may produce anelectrical current or voltage pulse that corresponds to the opticalpulse detected by the receiver 140. In an example implementation, thereceiver 140 includes one or more avalanche photodiodes (APDs) or one ormore single-photon avalanche diodes (SPADs). In another implementation,the receiver 140 includes one or more PN photodiodes (e.g., a photodiodestructure formed by a p-type semiconductor and a n-type semiconductor)or one or more PIN photodiodes (e.g., a photodiode structure formed byan undoped intrinsic semiconductor region located between p-type andn-type regions).

The receiver 140 may have an active region or anavalanche-multiplication region that includes silicon, germanium, orInGaAs. The active region of receiver 140 may have any suitable size,such as for example, a diameter or width of approximately 50-500 μm. Thereceiver 140 may include circuitry that performs signal amplification,sampling, filtering, signal conditioning, analog-to-digital conversion,time-to-digital conversion, pulse detection, threshold detection,rising-edge detection, or falling-edge detection. For example, thereceiver 140 may include a transimpedance amplifier that converts areceived photocurrent (e.g., a current produced by an APD in response toa received optical signal) into a voltage signal. The receiver 140 maydirect the voltage signal to pulse-detection circuitry that produces ananalog or digital output signal 145 that corresponds to one or morecharacteristics (e.g., rising edge, falling edge, amplitude, orduration) of a received optical pulse. For example, the pulse-detectioncircuitry may perform a time-to-digital conversion to produce a digitaloutput signal 145. The receiver 140 may send the electrical outputsignal 145 to the controller 150 for processing or analysis, e.g., todetermine a time-of-flight value corresponding to a received opticalpulse.

The controller 150 may be electrically coupled or otherwisecommunicatively coupled to one or more of the light source 110, thescanner 120, and the receiver 140. The controller 150 may receiveelectrical trigger pulses or edges from the light source 110, where eachpulse or edge corresponds to the emission of an optical pulse by thelight source 110. The controller 150 may provide instructions, a controlsignal, or a trigger signal to the light source 110 indicating when thelight source 110 should produce optical pulses. For example, thecontroller 150 may send an electrical trigger signal that includeselectrical pulses, where the light source 110 emits an optical pulse inresponse to each electrical pulse. Further, the controller 150 may causethe light source 110 to adjust one or more of the frequency, period,duration, pulse energy, peak power, average power, or wavelength of theoptical pulses produced by light source 110.

The controller 150 may determine a time-of-flight value for an opticalpulse based on timing information associated with when the pulse wasemitted by light source 110 and when a portion of the pulse (e.g., theinput beam 135) was detected or received by the receiver 140. Thecontroller 150 may include circuitry that performs signal amplification,sampling, filtering, signal conditioning, analog-to-digital conversion,time-to-digital conversion, pulse detection, threshold detection,rising-edge detection, or falling-edge detection.

As indicated above, the lidar system 100 may be used to determine thedistance to one or more downrange targets 130. By scanning the lidarsystem 100 across a field of regard, the system can be used to map thedistance to a number of points within the field of regard. Each of thesedepth-mapped points may be referred to as a pixel or a voxel. Acollection of pixels captured in succession (which may be referred to asa depth map, a point cloud, or a frame) may be rendered as an image ormay be analyzed to identify or detect objects or to determine a shape ordistance of objects within the FOR. For example, a depth map may cover afield of regard that extends 60° horizontally and 15° vertically, andthe depth map may include a frame of 100-2000 pixels in the horizontaldirection by 4-400 pixels in the vertical direction.

The lidar system 100 may be configured to repeatedly capture or generatepoint clouds of a field of regard at any suitable frame rate betweenapproximately 0.1 frames per second (FPS) and approximately 1,000 FPS.For example, the lidar system 100 may generate point clouds at a framerate of approximately 0.1 FPS, 0.5 FPS, 1 FPS, 2 FPS, 5 FPS, 10 FPS, 20FPS, 100 FPS, 500 FPS, or 1,000 FPS. In an example implementation, thelidar system 100 is configured to produce optical pulses at a rate of5×10⁵ pulses/second (e.g., the system may determine 500,000 pixeldistances per second) and scan a frame of 1000×50 pixels (e.g., 50,000pixels/frame), which corresponds to a point-cloud frame rate of 10frames per second (e.g., 10 point clouds per second). The point-cloudframe rate may be substantially fixed or dynamically adjustable,depending on the implementation. For example, the lidar system 100 maycapture one or more point clouds at a particular frame rate (e.g., 1 Hz)and then switch to capture one or more point clouds at a different framerate (e.g., 10 Hz). In general, the lidar system can use a slower framerate (e.g., 1 Hz) to capture one or more high-resolution point clouds,and use a faster frame rate (e.g., 10 Hz) to rapidly capture multiplelower-resolution point clouds.

The field of regard of the lidar system 100 can overlap, encompass, orenclose at least a portion of the target 130, which may include all orpart of an object that is moving or stationary relative to lidar system100. For example, the target 130 may include all or a portion of aperson, vehicle, motorcycle, truck, train, bicycle, wheelchair,pedestrian, animal, road sign, traffic light, lane marking, road-surfacemarking, parking space, pylon, guard rail, traffic barrier, pothole,railroad crossing, obstacle in or near a road, curb, stopped vehicle onor beside a road, utility pole, house, building, trash can, mailbox,tree, any other suitable object, or any suitable combination of all orpart of two or more objects.

Now referring to FIG. 2, a scanner 162 and a receiver 164 can operate inthe lidar system of FIG. 1 as the scanner 120 and the receiver 140,respectively. More generally, the scanner 162 and the receiver 164 canoperate in any suitable lidar system.

The scanner 162 may include any suitable number of mirrors driven by anysuitable number of mechanical actuators. For example, the scanner 162may include a galvanometer scanner, a resonant scanner, a piezoelectricactuator, a polygonal scanner, a rotating-prism scanner, a voice coilmotor, a DC motor, a brushless DC motor, a stepper motor, or amicroelectromechanical systems (MEMS) device, or any other suitableactuator or mechanism.

A galvanometer scanner (which also may be referred to as a galvanometeractuator) may include a galvanometer-based scanning motor with a magnetand coil. When an electrical current is supplied to the coil, arotational force is applied to the magnet, which causes a mirrorattached to the galvanometer scanner to rotate. The electrical currentsupplied to the coil may be controlled to dynamically change theposition of the galvanometer mirror. A resonant scanner (which may bereferred to as a resonant actuator) may include a spring-like mechanismdriven by an actuator to produce a periodic oscillation at asubstantially fixed frequency (e.g., 1 kHz). A MEMS-based scanningdevice may include a mirror with a diameter between approximately 1 and10 mm, where the mirror is rotated using electromagnetic orelectrostatic actuation. A voice coil motor (which may be referred to asa voice coil actuator) may include a magnet and coil. When an electricalcurrent is supplied to the coil, a translational force is applied to themagnet, which causes a mirror attached to the magnet to move or rotate.

In an example implementation, the scanner 162 includes a single mirrorconfigured to scan an output beam 170 along a single direction (e.g.,the scanner 162 may be a one-dimensional scanner that scans along ahorizontal or vertical direction). The mirror may be a flat scanningmirror attached to a scanner actuator or mechanism which scans themirror over a particular angular range. The mirror may be driven by oneactuator (e.g., a galvanometer) or two actuators configured to drive themirror in a push-pull configuration. When two actuators drive the mirrorin one direction in a push-pull configuration, the actuators may belocated at opposite ends or sides of the mirror. The actuators mayoperate in a cooperative manner so that when one actuator pushes on themirror, the other actuator pulls on the mirror, and vice versa. Inanother example implementation, two voice coil actuators arranged in apush-pull configuration drive a mirror along a horizontal or verticaldirection.

In some implementations, the scanner 162 may include one mirrorconfigured to be scanned along two axes, where two actuators arranged ina push-pull configuration provide motion along each axis. For example,two resonant actuators arranged in a horizontal push-pull configurationmay drive the mirror along a horizontal direction, and another pair ofresonant actuators arranged in a vertical push-pull configuration maydrive mirror along a vertical direction. In another exampleimplementation, two actuators scan the output beam 170 along twodirections (e.g., horizontal and vertical), where each actuator providesrotational motion along a particular direction or about a particularaxis.

The scanner 162 also may include one mirror driven by two actuatorsconfigured to scan the mirror along two substantially orthogonaldirections. For example, a resonant actuator or a galvanometer actuatormay drive one mirror along a substantially horizontal direction, and agalvanometer actuator may drive the mirror along a substantiallyvertical direction. As another example, two resonant actuators may drivea mirror along two substantially orthogonal directions.

In some implementations, the scanner 162 includes two mirrors, where onemirror scans the output beam 170 along a substantially horizontaldirection and the other mirror scans the output beam 170 along asubstantially vertical direction. In the example of FIG. 2, the scanner162 includes two mirrors, a mirror 180-1 and a mirror 180-2. The mirror180-1 may scan the output beam 170 along a substantially horizontaldirection, and the mirror 180-2 may scan the output beam 170 along asubstantially vertical direction (or vice versa). Mirror 180-1 or mirror180-2 may be a flat mirror, a curved mirror, or a polygon mirror withtwo or more reflective surfaces.

The scanner 162 in other implementations includes two galvanometerscanners driving respective mirrors. For example, the scanner 162 mayinclude a galvanometer actuator that scans the mirror 180-1 along afirst direction (e.g., vertical), and the scanner 162 may includeanother galvanometer actuator that scans the mirror 180-2 along a seconddirection (e.g., horizontal). In yet another implementation, the scanner162 includes two mirrors, where a galvanometer actuator drives onemirror, and a resonant actuator drives the other mirror. For example, agalvanometer actuator may scan the mirror 180-1 along a first direction,and a resonant actuator may scan the mirror 180-2 along a seconddirection. The first and second scanning directions may be substantiallyorthogonal to one another, e.g., the first direction may besubstantially vertical, and the second direction may be substantiallyhorizontal. In yet another implementation, the scanner 162 includes twomirrors, where one mirror is a polygon mirror that is rotated in onedirection (e.g., clockwise or counter-clockwise) by an electric motor(e.g., a brushless DC motor). For example, mirror 180-1 may be a polygonmirror that scans the output beam 170 along a substantially horizontaldirection, and mirror 180-2 may scan the output beam 170 along asubstantially vertical direction. A polygon mirror may have two or morereflective surfaces, and the polygon mirror may be continuously rotatedin one direction so that the output beam 170 is reflected sequentiallyfrom each of the reflective surfaces. A polygon mirror may have across-sectional shape that corresponds to a polygon, where each side ofthe polygon has a reflective surface. For example, a polygon mirror witha square cross-sectional shape may have four reflective surfaces, and apolygon mirror with a pentagonal cross-sectional shape may have fivereflective surfaces.

To direct the output beam 170 along a particular scan pattern, thescanner 162 may include two or more actuators driving a single mirrorsynchronously. For example, the two or more actuators can drive themirror synchronously along two substantially orthogonal directions tomake the output beam 170 follow a scan pattern with substantiallystraight lines. In some implementations, the scanner 162 may include twomirrors and actuators driving the two mirrors synchronously to generatea scan pattern that includes substantially straight lines. For example,a galvanometer actuator may drive the mirror 180-2 with a substantiallylinear back-and-forth motion (e.g., the galvanometer may be driven witha substantially sinusoidal or triangle-shaped waveform) that causes theoutput beam 170 to trace a substantially horizontal back-and-forthpattern, and another galvanometer actuator may scan the mirror 180-1along a substantially vertical direction. The two galvanometers may besynchronized so that for every 64 horizontal traces, the output beam 170makes a single trace along a vertical direction. Whether one or twomirrors are used, the substantially straight lines can be directedsubstantially horizontally, vertically, or along any other suitabledirection.

The scanner 162 also may apply a dynamically adjusted deflection along avertical direction (e.g., with a galvanometer actuator) as the outputbeam 170 is scanned along a substantially horizontal direction (e.g.,with a galvanometer or resonant actuator) to achieve the straight lines.If a vertical deflection is not applied, the output beam 170 may traceout a curved path as it scans from side to side. In someimplementations, the scanner 162 uses a vertical actuator to apply adynamically adjusted vertical deflection as the output beam 170 isscanned horizontally as well as a discrete vertical offset between eachhorizontal scan (e.g., to step the output beam 170 to a subsequent rowof a scan pattern).

With continued reference to FIG. 2, an overlap mirror 190 in thisexample implementation is configured to overlap the input beam 172 andoutput beam 170, so that the beams 170 and 172 are substantiallycoaxial. In FIG. 2, the overlap mirror 190 includes a hole, slot, oraperture 192 through which the output beam 170 passes, and a reflectingsurface 194 that reflects at least a portion of the input beam 172toward the receiver 164. The overlap mirror 190 may be oriented so thatinput beam 172 and output beam 170 are at least partially overlapped.

In some implementations, the overlap mirror 190 may not include a hole192. For example, the output beam 170 may be directed to pass by a sideof mirror 190 rather than passing through an aperture 192. The outputbeam 170 may pass alongside mirror 190 and may be oriented at a slightangle with respect to the orientation of the input beam 172. As anotherexample, the overlap mirror 190 may include a small reflective sectionconfigured to reflect the output beam 170, and the rest of the overlapmirror 190 may have an AR coating configured to transmit the input beam172.

The input beam 172 may pass through a lens 196 which focuses the beamonto an active region 166 of the receiver 164. The active region 166 mayrefer to an area over which receiver 164 may receive or detect inputlight. The active region may have any suitable size or diameter d, suchas for example, a diameter of approximately 25 μm, 50 μm, 80 μm, 100 μm,200 μm, 500 μm, 1 mm, 2 mm, or 5 mm. The overlap mirror 190 may have areflecting surface 194 that is substantially flat or the reflectingsurface 194 may be curved (e.g., the mirror 190 may be an off-axisparabolic mirror configured to focus the input beam 172 onto an activeregion of the receiver 140).

The aperture 192 may have any suitable size or diameter Φ₁, and theinput beam 172 may have any suitable size or diameter Φ₂, where Φ₂ isgreater than Φ₁. For example, the aperture 192 may have a diameter Φ₁ ofapproximately 0.2 mm, 0.5 mm, 1 mm, 2 mm, 3 mm, 5 mm, or 10 mm, and theinput beam 172 may have a diameter Φ₂ of approximately 2 mm, 5 mm, 10mm, 15 mm, 20 mm, 30 mm, 40 mm, or 50 mm. In some implementations, thereflective surface 194 of the overlap mirror 190 may reflect 70% or moreof input beam 172 toward the receiver 164. For example, if thereflective surface 194 has a reflectivity R at an operating wavelengthof the light source 160, then the fraction of input beam 172 directedtoward the receiver 164 may be expressed as R×[1−(Φ₁/Φ₂)²]. As a morespecific example, if R is 95%, Φ₁ is 2 mm, and Φ₂ is 10 mm, thenapproximately 91% of the input beam 172 may be directed toward thereceiver 164 by the reflective surface 194.

FIG. 3 illustrates an example configuration in which several componentsof the lidar system 100 may operate to scan a 360-degree view of regard.Generally speaking, the field of view of a light source in thisconfiguration follows a circular trajectory and accordingly defines acircular scan pattern on a two-dimensional plane. All points on thetrajectory remain at the same elevation relative to the ground level,according to one implementation. In this case, separate beams may followthe circular trajectory with certain vertical offsets relative to eachother. In another implementation, the points of the trajectory maydefine a spiral scan pattern in three-dimensional space. A single beamcan be sufficient to trace out the spiral scan pattern but, if desired,multiple beams can be used.

In the example of FIG. 3, a rotating scan module 200 revolves around acentral axis in one or both directions as indicated. An electric motormay drive the rotating scan module 200 around the central axis at aconstant speed, for example. The rotating scan module 200 includes ascanner, a receiver, an overlap mirror, etc. The components of therotating module 200 may be similar to the scanner 120, the receiver 140,and the overlap mirror 115. In some implementations, the subsystem 200also includes a light source and a controller. In other implementations,the light source and/or the controller are disposed apart from therotating scan module 200 and/or exchange optical and electrical signalswith the components of the rotating scan module 200 via correspondinglinks.

The rotating scan module 200 may include a housing 210 with a window212. Similar to the window 157 of FIG. 1, the window 212 may be made ofglass, plastic, or any other suitable material. The window 212 allowsoutbound beams as well as return signals to pass through the housing210. The arc length defined by the window 212 can correspond to anysuitable percentage of the circumference of the housing 210. Forexample, the arc length can correspond to 5%, 20%, 30%, 60%, or possiblyeven 100% of the circumference.

Now referring to FIG. 4, a rotating scan module 220 is generally similarto the rotating scan module 200. In this implementation, however, thecomponents of the rotating scan module 220 are disposed on a platform222 which rotates inside a stationary circular housing 230. In thisimplementation, the circular housing 230 is substantially transparent tolight at the lidar-system operating wavelength to pass inbound andoutbound light signals. The circular housing 230 in a sense defines acircular window similar to the window 212, and may be made of similarmaterial.

One type of lidar system 100 is a pulsed lidar system in which the lightsource 110 emits pulses of light, and the distance to a remote target130 is determined from the time-of-flight for a pulse of light to travelto the target 130 and back. Another type of lidar system 100 is afrequency-modulated lidar system, which may be referred to as afrequency-modulated continuous-wave (FMCW) lidar system. A FMCW lidarsystem uses frequency-modulated light to determine the distance to aremote target 130 based on a modulation frequency of the received light(which is scattered from a remote target) relative to the modulationfrequency of the emitted light. For example, for a linearly chirpedlight source (e.g., a frequency modulation that produces a linear changein frequency with time), the larger the frequency difference between theemitted light and the received light, the farther away the target 130 islocated. The frequency difference can be determined by mixing thereceived light with a portion of the emitted light (e.g., by couplingthe two beams onto an APD, or coupling analog electrical signals) andmeasuring the resulting beat frequency. For example, the electricalsignal from an APD can be analyzed using a fast Fourier transform (FFT)technique to determine the difference frequency between the emittedlight and the received light.

If a linear frequency modulation m (e.g., in units of Hz/s) is appliedto a CW laser, then the distance D from the target 130 to the lidarsystem 100 may be expressed as D=c·Δf/(2m), where c is the speed oflight and Δf is the difference in frequency between the transmittedlight and the received light. For example, for a linear frequencymodulation of 10¹² Hz/s (or, 1 MHz/μs), if a frequency difference of 330kHz is measured, then the distance to the target is approximately 50meters. Additionally, a frequency difference of 1.33 MHz corresponds toa target located approximately 200 meters away.

The light source 110 for a FMCW lidar system can be a fiber laser (e.g.,a seed laser diode followed by one or more optical amplifiers) or adirect-emitter laser diode. The seed laser diode or the direct-emitterlaser diode can be operated in a CW manner (e.g., by driving the laserdiode with a substantially constant DC current), and the frequencymodulation can be provided by an external modulator (e.g., anelectro-optic phase modulator). Alternatively, the frequency modulationcan be produced by applying a DC bias current along with a currentmodulation to the seed laser diode or the direct-emitter laser diode.The current modulation produces a corresponding refractive-indexmodulation in the laser diode, which results in a frequency modulationof the light emitted by the laser diode. The current-modulationcomponent (and corresponding frequency modulation) can have any suitablefrequency or shape (e.g., sinusoidal, triangle-wave, or sawtooth).

Generating Pixels within a Field of Regard

FIG. 5 illustrates an example scan pattern 240 which the lidar system100 of FIG. 1 can produce. The lidar system 100 may be configured toscan output optical beam 125 along one or more scan patterns 240. Insome implementations, the scan pattern 240 corresponds to a scan acrossany suitable field of regard (FOR) having any suitable horizontal FOR(FOR_(H)) and any suitable vertical FOR (FOR_(V)). For example, acertain scan pattern may have a field of regard represented by angulardimensions (e.g., FOR_(H)×FOR_(V)) 40°×30°, 90°×40°, or 60°×15°. Asanother example, a certain scan pattern may have a FOR_(H) greater thanor equal to 10°, 25°, 30°, 40°, 60°, 90°, or 120°. As yet anotherexample, a certain scan pattern may have a FOR_(V) greater than or equalto 2°, 5°, 10°, 15°, 20°, 30°, or 45°. In the example of FIG. 5,reference line 246 represents a center of the field of regard of scanpattern 240. The reference line 246 may have any suitable orientation,such as, a horizontal angle of 0° (e.g., reference line 246 may beoriented straight ahead) and a vertical angle of 0° (e.g., referenceline 246 may have an inclination of 0°), or the reference line 246 mayhave a nonzero horizontal angle or a nonzero inclination (e.g., avertical angle of +10° or −10°). In FIG. 5, if the scan pattern 240 hasa 60°×15° field of regard, then the scan pattern 240 covers a ±30°horizontal range with respect to reference line 246 and a ±7.5° verticalrange with respect to reference line 246. Additionally, the optical beam125 in FIG. 5 has an orientation of approximately −15° horizontal and+3° vertical with respect to reference line 246. The beam 125 may bereferred to as having an azimuth of −15° and an altitude of +3° relativeto the reference line 246. An azimuth (which may be referred to as anazimuth angle) may represent a horizontal angle with respect to thereference line 246, and an altitude (which may be referred to as analtitude angle, elevation, or elevation angle) may represent a verticalangle with respect to the reference line 246.

The scan pattern 240 may include multiple pixels 242, and each pixel 242may be associated with one or more laser pulses and one or morecorresponding distance measurements. A cycle of scan pattern 240 mayinclude a total of P_(x)×P_(y) pixels 242 (e.g., a two-dimensionaldistribution of P_(x) by P_(y) pixels). For example, the scan pattern240 may include a distribution with dimensions of approximately100-2,000 pixels 242 along a horizontal direction and approximately4-400 pixels 242 along a vertical direction. As another example, thescan pattern 240 may include a distribution of 1,000 pixels 242 alongthe horizontal direction by 64 pixels 242 along the vertical direction(e.g., the frame size is 1000×64 pixels) for a total of 64,000 pixelsper cycle of scan pattern 240. The number of pixels 242 along ahorizontal direction may be referred to as a horizontal resolution ofthe scan pattern 240, and the number of pixels 242 along a verticaldirection may be referred to as a vertical resolution of the scanpattern 240. As an example, the scan pattern 240 may have a horizontalresolution of greater than or equal to 100 pixels 242 and a verticalresolution of greater than or equal to 4 pixels 242. As another example,the scan pattern 240 may have a horizontal resolution of 100-2,000pixels 242 and a vertical resolution of 4-400 pixels 242.

Each pixel 242 may be associated with a distance (e.g., a distance to aportion of a target 130 from which the corresponding laser pulse wasscattered) or one or more angular values. As an example, the pixel 242may be associated with a distance value and two angular values (e.g., anazimuth and altitude) that represent the angular location of the pixel242 with respect to the lidar system 100. A distance to a portion of thetarget 130 may be determined based at least in part on a time-of-flightmeasurement for a corresponding pulse. An angular value (e.g., anazimuth or altitude) may correspond to an angle (e.g., relative toreference line 246) of the output beam 125 (e.g., when a correspondingpulse is emitted from lidar system 100) or an angle of the input beam135 (e.g., when an input signal is received by lidar system 100). Insome implementations, the lidar system 100 determines an angular valuebased at least in part on a position of a component of the scanner 120.For example, an azimuth or altitude value associated with the pixel 242may be determined from an angular position of one or more correspondingscanning mirrors of the scanner 120.

In some implementations, the lidar system 100 concurrently directsmultiple beams across the field of regard. In the example implementationof FIG. 6, the lidar system generates output beams 250A, 250B, 250C, . .. 250N etc., each of which follows a linear scan pattern 254A, 254B,254C, . . . 254N. The number of parallel lines can be 2, 4, 12, 20, orany other suitable number. The lidar system 100 may angularly separatethe beams 250A, 250B, 250C, . . . 250N, so that, for example, theseparation between beams 250A and 250B at a certain distance may be 30cm, and the separation between the same beams 250A and 250B at a longerdistance may be 50 cm.

Similar to the scan pattern 240, each of the linear scan patterns 254A-Nincludes pixels associated with one or more laser pulses and distancemeasurements. FIG. 6 illustrates example pixels 252A, 252B and 252Calong the scan patterns 254A, 254B and 254C, respectively. The lidarsystem 100 in this example may generate the values for the pixels252A-252N at the same time, thus increasing the rate at which values forpixels are determined.

Depending on the implementation, the lidar system 100 may output thebeams 250A-N at the same wavelength or different wavelengths. The beam250A for example may have the wavelength of 1540 nm, the beam 250B mayhave the wavelength of 1550 nm, the beam 250C may have the wavelength of1560 nm, etc. The number of different wavelengths the lidar system 100uses need not match the number of beams. Thus, the lidar system 100 inthe example implementation of FIG. 6 may use M wavelengths with N beams,where 1≤M≤N.

Next, FIG. 7 illustrates an example light-source field of view (FOV_(L))and receiver field of view (FOV_(R)) for the lidar system 100. The lightsource 110 may emit pulses of light as the FOV_(L) and FOV_(R) arescanned by the scanner 120 across a field of regard (FOR). Thelight-source field of view may refer to an angular cone illuminated bythe light source 110 at a particular instant of time. Similarly, areceiver field of view may refer to an angular cone over which thereceiver 140 may receive or detect light at a particular instant oftime, and any light outside the receiver field of view may not bereceived or detected. For example, as the scanner 120 scans thelight-source field of view across a field of regard, the lidar system100 may send the pulse of light in the direction the FOV_(L) is pointingat the time the light source 110 emits the pulse. The pulse of light mayscatter off the target 130, and the receiver 140 may receive and detecta portion of the scattered light that is directed along or containedwithin the FOV_(R).

In some implementations, the scanner 120 is configured to scan both alight-source field of view and a receiver field of view across a fieldof regard of the lidar system 100. The lidar system 100 may emit anddetect multiple pulses of light as the scanner 120 scans the FOV_(L) andFOV_(R) across the field of regard while tracing out the scan pattern240. The scanner 120 in some implementations scans the light-sourcefield of view and the receiver field of view synchronously with respectto one another. In this case, as the scanner 120 scans FOV_(L) across ascan pattern 240, the FOV_(R) follows substantially the same path at thesame scanning speed. Additionally, the FOV_(L) and FOV_(R) may maintainthe same relative position to one another as the scanner 120 scansFOV_(L) and FOV_(R) across the field of regard. For example, the FOV_(L)may be substantially overlapped with or centered inside the FOV_(R) (asillustrated in FIG. 7), and the scanner 120 may maintain this relativepositioning between FOV_(L) and FOV_(R) throughout a scan. As anotherexample, the FOV_(R) may lag behind the FOV_(L) by a particular, fixedamount throughout a scan (e.g., the FOV_(R) may be offset from theFOV_(L) in a direction opposite the scan direction).

The FOV_(L) may have an angular size or extent Θ_(L) that issubstantially the same as or that corresponds to the divergence of theoutput beam 125, and the FOV_(R) may have an angular size or extentΘ_(R) that corresponds to an angle over which the receiver 140 mayreceive and detect light. The receiver field of view may be any suitablesize relative to the light-source field of view. For example, thereceiver field of view may be smaller than, substantially the same sizeas, or larger than the angular extent of the light-source field of view.In some implementations, the light-source field of view has an angularextent of less than or equal to 50 milliradians, and the receiver fieldof view has an angular extent of less than or equal to 50 milliradians.The FOV_(L) may have any suitable angular extent Θ_(L), such as forexample, approximately 0.1 mrad, 0.2 mrad, 0.5 mrad, 1 mrad, 1.5 mrad, 2mrad, 3 mrad, 5 mrad, 10 mrad, 20 mrad, 40 mrad, or 50 mrad. Similarly,the FOV_(R) may have any suitable angular extent Θ_(R), such as forexample, approximately 0.1 mrad, 0.2 mrad, 0.5 mrad, 1 mrad, 1.5 mrad, 2mrad, 3 mrad, 5 mrad, 10 mrad, 20 mrad, 40 mrad, or 50 mrad. Thelight-source field of view and the receiver field of view may haveapproximately equal angular extents. As an example, Θ_(L) and Θ_(R) mayboth be approximately equal to 1 mrad, 2 mrad, or 3 mrad. In someimplementations, the receiver field of view is larger than thelight-source field of view, or the light-source field of view is largerthan the receiver field of view. For example, Θ_(L) may be approximatelyequal to 1.5 mrad, and Θ_(R) may be approximately equal to 3 mrad.

A pixel 242 may represent or correspond to a light-source field of view.As the output beam 125 propagates from the light source 110, thediameter of the output beam 125 (as well as the size of thecorresponding pixel 242) may increase according to the beam divergenceΘ_(L). As an example, if the output beam 125 has a Θ_(L) of 2 mrad, thenat a distance of 100 m from the lidar system 100, the output beam 125may have a size or diameter of approximately 20 cm, and a correspondingpixel 242 may also have a corresponding size or diameter ofapproximately 20 cm. At a distance of 200 m from the lidar system 100,the output beam 125 and the corresponding pixel 242 may each have adiameter of approximately 40 cm.

A Lidar System Operating in a Vehicle

As indicated above, one or more lidar systems 100 may be integrated intoa vehicle. In one example implementation, multiple lidar systems 100 maybe integrated into a car to provide a complete 360-degree horizontal FORaround the car. As another example, 4-10 lidar systems 100, each systemhaving a 45-degree to 90-degree horizontal FOR, may be combined togetherto form a sensing system that provides a point cloud covering a360-degree horizontal FOR. The lidar systems 100 may be oriented so thatadjacent FORs have an amount of spatial or angular overlap to allow datafrom the multiple lidar systems 100 to be combined or stitched togetherto form a single or continuous 360-degree point cloud. As an example,the FOR of each lidar system 100 may have approximately 1-15 degrees ofoverlap with an adjacent FOR. In particular embodiments, a vehicle mayrefer to a mobile machine configured to transport people or cargo. Forexample, a vehicle may include, may take the form of, or may be referredto as a car, automobile, motor vehicle, truck, bus, van, trailer,off-road vehicle, farm vehicle, lawn mower, construction equipment,forklift, robot, golf cart, motorhome, taxi, motorcycle, scooter,bicycle, skateboard, train, snowmobile, watercraft (e.g., a ship orboat), aircraft (e.g., a fixed-wing aircraft, helicopter, or dirigible),or spacecraft. In particular embodiments, a vehicle may include aninternal combustion engine or an electric motor that provides propulsionfor the vehicle.

In some implementations, one or more lidar systems 100 are included in avehicle as part of an advanced driver assistance system (ADAS) to assista driver of the vehicle in the driving process. For example, a lidarsystem 100 may be part of an ADAS that provides information or feedbackto a driver (e.g., to alert the driver to potential problems or hazards)or that automatically takes control of part of a vehicle (e.g., abraking system or a steering system) to avoid collisions or accidents.The lidar system 100 may be part of a vehicle ADAS that providesadaptive cruise control, automated braking, automated parking, collisionavoidance, alerts the driver to hazards or other vehicles, maintains thevehicle in the correct lane, or provides a warning if an object oranother vehicle is in a blind spot.

In some cases, one or more lidar systems 100 are integrated into avehicle as part of an autonomous-vehicle driving system. In an exampleimplementation, the lidar system 100 provides information about thesurrounding environment to a driving system of an autonomous vehicle. Anautonomous-vehicle driving system may include one or more computingsystems that receive information from the lidar system 100 about thesurrounding environment, analyze the received information, and providecontrol signals to the vehicle's driving systems (e.g., steering wheel,accelerator, brake, or turn signal). For example, the lidar system 100integrated into an autonomous vehicle may provide an autonomous-vehicledriving system with a point cloud every 0.1 seconds (e.g., the pointcloud has a 10 Hz update rate, representing 10 frames per second). Theautonomous-vehicle driving system may analyze the received point cloudsto sense or identify targets 130 and their respective locations,distances, or speeds, and the autonomous-vehicle driving system mayupdate control signals based on this information. As an example, if thelidar system 100 detects a vehicle ahead that is slowing down orstopping, the autonomous-vehicle driving system may send instructions torelease the accelerator and apply the brakes.

An autonomous vehicle may be referred to as an autonomous car,driverless car, self-driving car, robotic car, or unmanned vehicle. Anautonomous vehicle may be a vehicle configured to sense its environmentand navigate or drive with little or no human input. For example, anautonomous vehicle may be configured to drive to any suitable locationand control or perform all safety-critical functions (e.g., driving,steering, braking, parking) for the entire trip, with the driver notexpected to control the vehicle at any time. As another example, anautonomous vehicle may allow a driver to safely turn their attentionaway from driving tasks in particular environments (e.g., on freeways),or an autonomous vehicle may provide control of a vehicle in all but afew environments, requiring little or no input or attention from thedriver.

An autonomous vehicle may be configured to drive with a driver presentin the vehicle, or an autonomous vehicle may be configured to operatethe vehicle with no driver present. As an example, an autonomous vehiclemay include a driver's seat with associated controls (e.g., steeringwheel, accelerator pedal, and brake pedal), and the vehicle may beconfigured to drive with no one seated in the driver's seat or withlittle or no input from a person seated in the driver's seat. As anotherexample, an autonomous vehicle may not include any driver's seat orassociated driver's controls, and the vehicle may perform substantiallyall driving functions (e.g., driving, steering, braking, parking, andnavigating) without human input. As another example, an autonomousvehicle may be configured to operate without a driver (e.g., the vehiclemay be configured to transport human passengers or cargo without adriver present in the vehicle). As another example, an autonomousvehicle may be configured to operate without any human passengers (e.g.,the vehicle may be configured for transportation of cargo without havingany human passengers onboard the vehicle).

In some implementations, a light source of a lidar system is locatedremotely from some of the other components of the lidar system such asthe scanner and the receiver. Moreover, a lidar system implemented in avehicle may include fewer light sources than scanners and receivers.

FIG. 8 illustrates an example configuration in which a laser-sensor link320 includes an optical link 330 and an electrical link 350 coupledbetween a laser 300 and a sensor 310. The laser 300 may be configured toemit pulses of light and may be referred to as a laser system, laserhead, or light source. The laser 300 may include, may be part of, may besimilar to, or may be substantially the same as the light source 110illustrated in FIG. 1 and discussed above. Further, the scanner 302, thereceiver 304, the controller 306, and the mirror 308 may be similar tothe scanner 120, the receiver 140, the controller 150, and the mirror115 discussed above. In the example of FIG. 8, the laser 300 is coupledto the remotely located sensor 310 by a laser-sensor link 320 (which maybe referred to as a link). The sensor 310 may be referred to as a sensorhead and may include the mirror 308, the scanner 302, the receiver 304,and the controller 306. In an example implementation, the laser 300includes a pulsed laser diode (e.g., a pulsed DFB laser) followed by anoptical amplifier, and light from the laser 300 is conveyed by anoptical fiber of the laser-sensor link 320 of a suitable length to thescanner 120 in a remotely located sensor 310.

The laser-sensor link 320 may include any suitable number of opticallinks 330 (e.g., 0, 1, 2, 3, 5, or 10) and any suitable number ofelectrical links 350 (e.g., 0, 1, 2, 3, 5, or 10). In the exampleconfiguration depicted in FIG. 8, the laser-sensor link 320 includes oneoptical link 330 from the laser 300 to an output collimator 340 and oneelectrical link 350 that connects the laser 300 to the controller 150.The optical link 330 may include optical fiber (which may be referred toas fiber-optic cable or fiber) that conveys, carries, transports, ortransmits light between the laser 300 and the sensor 310. The opticalfiber may be, for example, single-mode (SM) fiber, multi-mode (MM)fiber, large-mode-area (LMA) fiber, polarization-maintaining (PM) fiber,photonic-crystal or photonic-bandgap fiber, gain fiber (e.g.,rare-earth-doped optical fiber for use in an optical amplifier), or anysuitable combination thereof. The output collimator 340 receives opticalpulses conveyed from the laser 300 by the optical link 330 and producesa free-space optical beam 312 that includes the optical pulses. Theoutput collimator 340 directs the free-space optical beam 312 throughthe mirror 308 and to the scanner 302.

The electrical link 350 may include electrical wire or cable (e.g., acoaxial cable or twisted-pair cable) that conveys or transmitselectrical power and/or one or more electrical signals between the laser300 and the sensor 310. For example, the laser 300 may include a powersupply or a power conditioner that provides electrical power to thelaser 300, and additionally, the power supply or power conditioner mayprovide power to one or more components of the sensor 310 (e.g., thescanner 304, the receiver 304, and/or the controller 306) via the one ormore electrical links 350. The electrical link 350 in someimplementations may convey electrical signals that include data orinformation in analog or digital format. Further, the electrical link350 may provide an interlock signal from the sensor 310 to the laser300. If the controller 306 detects a fault condition indicating aproblem with the sensor 310 or the overall lidar system, the controller306 may change a voltage on the interlock line (e.g., from 5 V to 0 V)indicating that the laser 300 should shut down, stop emitting light, orreduce the power or energy of emitted light. A fault condition may betriggered by a failure of the scanner 302, a failure of the receiver304, or by a person or object coming within a threshold distance of thesensor 310 (e.g., within 0.1 m, 0.5 m, 1 m, 5 m, or any other suitabledistance).

As discussed above, a lidar system can include one or more processors todetermine a distance D to a target. In the implementation illustrated inFIG. 8, the controller 306 may be located in the laser 300 or in thesensor 310, or parts of the controller 150 may be distributed betweenthe laser 300 and the sensor 310. In an example implementation, eachsensor head 310 of a lidar system includes electronics (e.g., anelectronic filter, transimpedance amplifier, threshold detector, ortime-to-digital (TDC) converter) configured to receive or process asignal from the receiver 304 or from an APD or SPAD of the receiver 304.Additionally, the laser 300 may include processing electronicsconfigured to determine a time-of-flight value or a distance to thetarget based on a signal received from the sensor head 310 via theelectrical link 350.

Next, FIG. 9 illustrates an example vehicle 354 with a lidar system 351that includes a laser 352 with multiple sensor heads 360 coupled to thelaser 352 via multiple laser-sensor links 370. The laser 352 and thesensor heads 360 may be similar to the laser 300 and the sensor 310discussed above, in some implementations. For example, each of thelaser-sensor links 370 may include one or more optical links and/or oneor more electrical links. The sensor heads 360 in FIG. 9 are positionedor oriented to provide a greater than 30-degree view of an environmentaround the vehicle. More generally, a lidar system with multiple sensorheads may provide a horizontal field of regard around a vehicle ofapproximately 30°, 45°, 60°, 90°, 120°, 180°, 270°, or 360°. Each of thesensor heads may be attached to or incorporated into a bumper, fender,grill, side panel, spoiler, roof, headlight assembly, taillightassembly, rear-view mirror assembly, hood, trunk, window, or any othersuitable part of the vehicle.

In the example of FIG. 9, four sensor heads 360 are positioned at ornear the four corners of the vehicle (e.g., the sensor heads may beincorporated into a light assembly, side panel, bumper, or fender), andthe laser 352 may be located within the vehicle (e.g., in or near thetrunk). The four sensor heads 360 may each provide a 90° to 120°horizontal field of regard (FOR), and the four sensor heads 360 may beoriented so that together they provide a complete 360-degree view aroundthe vehicle. As another example, the lidar system 351 may include sixsensor heads 360 positioned on or around a vehicle, where each of thesensor heads 360 provides a 60° to 90° horizontal FOR. As anotherexample, the lidar system 351 may include eight sensor heads 360, andeach of the sensor heads 360 may provide a 45° to 60° horizontal FOR. Asyet another example, the lidar system 351 may include six sensor heads360, where each of the sensor heads 360 provides a 70° horizontal FORwith an overlap between adjacent FORs of approximately 10°. As anotherexample, the lidar system 351 may include two sensor heads 360 whichtogether provide a horizontal FOR of greater than or equal to 30°.

Data from each of the sensor heads 360 may be combined or stitchedtogether to generate a point cloud that covers a greater than or equalto 30-degree horizontal view around a vehicle. For example, the laser352 may include a controller or processor that receives data from eachof the sensor heads 360 (e.g., via a corresponding electrical link 370)and processes the received data to construct a point cloud covering a360-degree horizontal view around a vehicle or to determine distances toone or more targets. The point cloud or information from the point cloudmay be provided to a vehicle controller 372 via a correspondingelectrical, optical, or radio link 370. In some implementations, thepoint cloud is generated by combining data from each of the multiplesensor heads 360 at a controller included within the laser 352 andprovided to the vehicle controller 372. In other implementations, eachof the sensor heads 360 includes a controller or process that constructsa point cloud for a portion of the 360-degree horizontal view around thevehicle and provides the respective point cloud to the vehiclecontroller 372. The vehicle controller 372 then combines or stitchestogether the points clouds from the respective sensor heads 360 toconstruct a combined point cloud covering a 360-degree horizontal view.Still further, the vehicle controller 372 in some implementationscommunicates with a remote server to process point cloud data.

In any event, the vehicle 354 may be an autonomous vehicle where thevehicle controller 372 provides control signals to various components390 within the vehicle 354 to maneuver and otherwise control operationof the vehicle 354. The components 390 are depicted in an expanded viewin FIG. 9 for ease of illustration only. The components 390 may includean accelerator 374, brakes 376, a vehicle engine 378, a steeringmechanism 380, lights 382 such as brake lights, head lights, reverselights, emergency lights, etc., a gear selector 384, and/or othersuitable components that effectuate and control movement of the vehicle354. The gear selector 384 may include the park, reverse, neutral, drivegears, etc. Each of the components 390 may include an interface viawhich the component receives commands from the vehicle controller 372such as “increase speed,” “decrease speed,” “turn left 5 degrees,”“activate left turn signal,” etc. and, in some cases, provides feedbackto the vehicle controller 372.

In some implementations, the vehicle controller 372 receives point clouddata from the laser 352 or sensor heads 360 via the link 370 andanalyzes the received point cloud data to sense or identify targets 130and their respective locations, distances, speeds, shapes, sizes, typeof target (e.g., vehicle, human, tree, animal), etc. The vehiclecontroller 372 then provides control signals via the link 370 to thecomponents 390 to control operation of the vehicle based on the analyzedinformation. For example, the vehicle controller 372 may identify anintersection based on the point cloud data and determine that theintersection is the appropriate location at which to make a left turn.Accordingly, the vehicle controller 372 may provide control signals tothe steering mechanism 380, the accelerator 374, and brakes 376 formaking a proper left turn. In another example, the vehicle controller372 may identify a traffic light based on the point cloud data anddetermine that the vehicle 354 needs to come to a stop. As a result, thevehicle controller 372 may provide control signals to release theaccelerator 374 and apply the brakes 376.

Example Receiver Implementation

FIG. 10 illustrates an example InGaAs avalanche photodiode (APD) 400.Referring back to FIG. 1, the receiver 140 may include one or more APDs400 configured to receive and detect light from input light such as thebeam 135. More generally, the APD 400 can operate in any suitablereceiver of input light. The APD 400 may be configured to detect aportion of pulses of light which are scattered by a target locateddownrange from the lidar system in which the APD 400 operates. Forexample, the APD 400 may receive a portion of a pulse of light scatteredby the target 130 depicted in FIG. 1, and generate an electrical-currentsignal corresponding to the received pulse of light.

The APD 400 may include doped or undoped layers of any suitablesemiconductor material, such as for example, silicon, germanium, InGaAs,InGaAsP, or indium phosphide (InP). Additionally, the APD 400 mayinclude an upper electrode 402 and a lower electrode 406 for couplingthe ADP 400 to an electrical circuit. The APD 400 for example may beelectrically coupled to a voltage source that supplies a reverse-biasvoltage V to the APD 400. Additionally, the APD 400 may be electricallycoupled to a transimpedance amplifier which receives electrical currentgenerated by the APD 400 and produces an output voltage signal thatcorresponds to the received current. The upper electrode 402 or lowerelectrode 406 may include any suitable electrically conductive material,such as for example a metal (e.g., gold, copper, silver, or aluminum), atransparent conductive oxide (e.g., indium tin oxide), a carbon-nanotubematerial, or polysilicon. In some implementations, the upper electrode402 is partially transparent or has an opening to allow input light 410to pass through to the active region of the APD 400. In FIG. 10, theupper electrode 402 may have a ring shape that at least partiallysurrounds the active region of the APD 400, where the active regionrefers to an area over which the APD 400 may receive and detect theinput light 410. The active region may have any suitable size ordiameter d, such as for example, a diameter of approximately 25 μm, 50μm, 80 μm, 100 μm, 200 μm, 500 μm, 1 mm, 2 mm, or 5 mm.

The APD 400 may include any suitable combination of any suitablesemiconductor layers having any suitable doping (e.g., n-doped, p-doped,or intrinsic undoped material). In the example of FIG. 10, the InGaAsAPD 400 includes a p-doped InP layer 420, an InP avalanche layer 422, anabsorption layer 424 with n-doped InGaAs or InGaAsP, and an n-doped InPsubstrate layer 426. Depending on the implementation, the APD 400 mayinclude separate absorption and avalanche layers, or a single layer mayact as both an absorption and avalanche region. The APD 400 may operateelectrically as a PN diode or a PIN diode, and, during operation, theAPD 400 may be reverse-biased with a positive voltage V applied to thelower electrode 406 with respect to the upper electrode 402. The appliedreverse-bias voltage V may have any suitable value, such as for exampleapproximately 5 V, 10 V, 20 V, 30 V, 50 V, 75 V, 100 V, or 200 V.

In FIG. 10, photons of the input light 410 may be absorbed primarily inthe absorption layer 424, resulting in the generation of electron-holepairs (which may be referred to as photo-generated carriers). Forexample, the absorption layer 424 may be configured to absorb photonscorresponding to the operating wavelength of the lidar system 100 (e.g.,any suitable wavelength between approximately 1400 nm and approximately1600 nm). In the avalanche layer 422, an avalanche-multiplicationprocess occurs where carriers (e.g., electrons or holes) generated inthe absorption layer 424 collide with the semiconductor lattice of theabsorption layer 424, and produce additional carriers through impactionization. This avalanche process can repeat numerous times so that onephoto-generated carrier may result in the generation of multiplecarriers. As an example, a single photon absorbed in the absorptionlayer 424 may lead to the generation of approximately 10, 50, 100, 200,500, 1000, 10,000, or any other suitable number of carriers through anavalanche-multiplication process. The carriers generated in an APD 400may produce an electrical current that is coupled to an electricalcircuit which may perform signal amplification, sampling, filtering,signal conditioning, analog-to-digital conversion, time-to-digitalconversion, pulse detection, threshold detection, rising-edge detection,or falling-edge detection.

The number of carriers generated from a single photo-generated carriermay increase as the applied reverse bias V is increased. If the appliedreverse bias V is increased above a particular value referred to as theAPD breakdown voltage, then a single carrier can trigger aself-sustaining avalanche process (e.g., the output of the APD 400 issaturated regardless of the input light level). The APD 400 that isoperated at or above a breakdown voltage may be referred to as asingle-photon avalanche diode (SPAD) and may be referred to as operatingin a Geiger mode or a photon-counting mode. The APD 400 that is operatedbelow a breakdown voltage may be referred to as a linear APD, and theoutput current generated by the APD 400 may be sent to an amplifiercircuit (e.g., a transimpedance amplifier). The receiver 140 (seeFIG. 1) may include an APD configured to operate as a SPAD and aquenching circuit configured to reduce a reverse-bias voltage applied tothe SPAD when an avalanche event occurs in the SPAD. The APD 400configured to operate as a SPAD may be coupled to an electronicquenching circuit that reduces the applied voltage V below the breakdownvoltage when an avalanche-detection event occurs. Reducing the appliedvoltage may halt the avalanche process, and the applied reverse-biasvoltage may then be re-set to await a subsequent avalanche event.Additionally, the APD 400 may be coupled to a circuit that generates anelectrical output pulse or edge when an avalanche event occurs.

In some implementations, the APD 400 or the APD 400 along withtransimpedance amplifier have a noise-equivalent power (NEP) that isless than or equal to 100 photons, 50 photons, 30 photons, 20 photons,or 10 photons. For example, the APD 400 may be operated as a SPAD andmay have a NEP of less than or equal to 20 photons. As another example,the APD 400 may be coupled to a transimpedance amplifier that producesan output voltage signal with a NEP of less than or equal to 50 photons.The NEP of the APD 400 is a metric that quantifies the sensitivity ofthe APD 400 in terms of a minimum signal (or a minimum number ofphotons) that the APD 400 can detect. The NEP may correspond to anoptical power (or to a number of photons) that results in asignal-to-noise ratio of 1, or the NEP may represent a threshold numberof photons above which an optical signal may be detected. For example,if the APD 400 has a NEP of 20 photons, then the input beam 410 with 20photons may be detected with a signal-to-noise ratio of approximately 1(e.g., the APD 400 may receive 20 photons from the input beam 410 andgenerate an electrical signal representing the input beam 410 that has asignal-to-noise ratio of approximately 1). Similarly, the input beam 410with 100 photons may be detected with a signal-to-noise ratio ofapproximately 5. In some implementations, the lidar system 100 with theAPD 400 (or a combination of the APD 400 and transimpedance amplifier)having a NEP of less than or equal to 100 photons, 50 photons, 30photons, 20 photons, or 10 photons offers improved detection sensitivitywith respect to a conventional lidar system that uses a PN or PINphotodiode. For example, an InGaAs PIN photodiode used in a conventionallidar system may have a NEP of approximately 10⁴ to 10⁵ photons, and thenoise level in a lidar system with an InGaAs PIN photodiode may be 10³to 10⁴ times greater than the noise level in a lidar system 100 with theInGaAs APD detector 400.

Referring back to FIG. 1, an optical filter may be located in front ofthe receiver 140 and configured to transmit light at one or moreoperating wavelengths of the light source 110 and attenuate light atsurrounding wavelengths. For example, an optical filter may be afree-space spectral filter located in front of APD 400 of FIG. 10. Thisspectral filter may transmit light at the operating wavelength of thelight source 110 (e.g., between approximately 1530 nm and 1560 nm) andattenuate light outside that wavelength range. As a more specificexample, light with wavelengths of approximately 400-1530 nm or1560-2000 nm may be attenuated by any suitable amount, such as forexample, by at least 5 dB, 10 dB, 20 dB, 30 dB, or 40 dB.

Next, FIG. 11 illustrates an APD 502 coupled to an examplepulse-detection circuit 504. The APD 502 can be similar to the APD 400discussed above with reference to FIG. 10, or can be any other suitabledetector. The pulse-detection circuit 504 can operate in the lidarsystem of FIG. 1 as part of the receiver 140. Further, thepulse-detection circuit 504 can operate in the receiver 164 of FIG. 2,the receiver 304 of FIG. 8, or any other suitable receiver. Thepulse-detection circuit 504 alternatively can be implemented in thecontroller 150, the controller 306, or another suitable controller. Insome implementations, parts of the pulse-detection circuit 504 canoperate in a receiver and other parts of the pulse-detection circuit 504can operate in a controller. For example, components 510 and 512 may bea part of the receiver 140, and components 514 and 516 may be a part ofthe controller 150.

The pulse-detection circuit 504 may include circuitry that receives asignal from a detector (e.g., an electrical current from the APD 502)and performs current-to-voltage conversion, signal amplification,sampling, filtering, signal conditioning, analog-to-digital conversion,time-to-digital conversion, pulse detection, threshold detection,rising-edge detection, or falling-edge detection. The pulse-detectioncircuit 504 may determine whether an optical pulse has been received bythe APD 502 or may determine a time associated with receipt of anoptical pulse by the APD 502. Additionally, the pulse-detection circuit504 may determine a duration of a received optical pulse. In an exampleimplementation, the pulse-detection circuit 504 includes atransimpedance amplifier (TIA) 510, a gain circuit 512, a comparator514, and a time-to-digital converter (TDC) 516.

The TIA 510 may be configured to receive an electrical-current signalfrom the APD 502 and produce a voltage signal that corresponds to thereceived electrical-current signal. For example, in response to areceived optical pulse, the APD 502 may produce a current pulsecorresponding to the optical pulse. The TIA 510 may receive the currentpulse from the APD 502 and produce a voltage pulse that corresponds tothe received current pulse. The TIA 510 may also act as an electronicfilter. For example, the TIA 510 may be configured as a low-pass filterthat removes or attenuates high-frequency electrical noise byattenuating signals above a particular frequency (e.g., above 1 MHz, 10MHz, 20 MHz, 50 MHz, 100 MHz, 200 MHz, or any other suitable frequency).

The gain circuit 512 may be configured to amplify a voltage signal. Asan example, the gain circuit 512 may include one or morevoltage-amplification stages that amplify a voltage signal received fromthe TIA 510. For example, the gain circuit 512 may receive a voltagepulse from the TIA 510, and the gain circuit 512 may amplify the voltagepulse by any suitable amount, such as for example, by a gain ofapproximately 3 dB, 10 dB, 20 dB, 30 dB, 40 dB, or 50 dB. Additionally,the gain circuit 512 may also act as an electronic filter configured toremove or attenuate electrical noise.

The comparator 514 may be configured to receive a voltage signal fromthe TIA 510 or the gain circuit 512 and produce an electrical-edgesignal (e.g., a rising edge or a falling edge) when the received voltagesignal rises above or falls below a particular threshold voltage V_(T).As an example, when a received voltage rises above V_(T), the comparator514 may produce a rising-edge digital-voltage signal (e.g., a signalthat steps from approximately 0 V to approximately 2.5 V, 3.3 V, 5 V, orany other suitable digital-high level). As another example, when areceived voltage falls below V_(T), the comparator 514 may produce afalling-edge digital-voltage signal (e.g., a signal that steps down fromapproximately 2.5 V, 3.3 V, 5 V, or any other suitable digital-highlevel to approximately 0 V). The voltage signal received by thecomparator 514 may be received from the TIA 510 or the gain circuit 512and may correspond to an electrical-current signal generated by the APD502. For example, the voltage signal received by the comparator 514 mayinclude a voltage pulse that corresponds to an electrical-current pulseproduced by the APD 502 in response to receiving an optical pulse. Thevoltage signal received by the comparator 514 may be an analog signal,and an electrical-edge signal produced by the comparator 514 may be adigital signal.

The time-to-digital converter (TDC) 516 may be configured to receive anelectrical-edge signal from the comparator 514 and determine an intervalof time between emission of a pulse of light by the light source andreceipt of the electrical-edge signal. The output of the TDC 516 may bea numerical value that corresponds to the time interval determined bythe TDC 516. In some implementations, the TDC 516 has an internalcounter or clock with any suitable period, such as for example, 5 ps, 10ps, 15 ps, 20 ps, 30 ps, 50 ps, 100 ps, 0.5 ns, 1 ns, 2 ns, 5 ns, or 10ns. The TDC 516 for example may have an internal counter or clock with a20 ps period, and the TDC 516 may determine that an interval of timebetween emission and receipt of a pulse is equal to 25,000 time periods,which corresponds to a time interval of approximately 0.5 microseconds.Referring back to FIG. 1, the TDC 516 may send the numerical value“25000” to a processor or controller 150 of the lidar system 100, whichmay include a processor configured to determine a distance from thelidar system 100 to the target 130 based at least in part on an intervalof time determined by a TDC 516. The processor may receive a numericalvalue (e.g., “25000”) from the TDC 516 and, based on the received value,the processor may determine the distance from the lidar system 100 to atarget 130.

Configuring Secondary Optical Signals for Multispectral Sensing withLidar

As indicated above, a lidar system can use the scanner to collectinformation in different secondary wavelength ranges to supplement theranging information collected at the primary wavelength corresponding tothe laser of the lidar. Each secondary wavelength range can berepresented by a nominal secondary wavelength. The secondaryinformation, collected at the secondary wavelengths, can improve thesituational awareness of the platform on which the lidar is operating(e.g., a vehicle). The benefits of using the scanner of the lidar tocollect information on secondary wavelengths can include inherentregistration of secondary information to the primary range information,reduction of cost in comparison to integration of independent sensingsystems, reduction in required computing resources by intelligent dataacquisition, etc.

FIG. 12 illustrates an example implementation of a multispectral lidarsystem 600. A light source of the multispectral lidar system 600, notillustrated to reduce clutter, can output a laser beam operating at acertain wavelength λ_(LASER), which can be referred to below as theprimary wavelength. In operation, the light source emits a pulse oflight directed by a scanner 610 toward a remote target. The scanner 610then directs some of the light scattered by the remote target toward alaser detector 620, which defines the first or primary detector of themultispectral lidar system 600. The scanner 610 can be generally similarto the scanner 120, 162, etc., and the detector 620 can be generallysimilar to the detector 166 discussed above.

A detector 630A can operate as a secondary wavelength detector anddetect light at a corresponding secondary wavelength. The secondarywavelength need not correspond to active sensing, i.e., a light signalemitted by the multispectral lidar system 600. Accordingly, themultispectral lidar system 600 can include any suitable number ofsecondary wavelength detectors, such as for example a detector 630Bconfigured to detect light at a third wavelength.

The secondary detectors 630A, 630B, etc. can be configured to detectlight signals at wavelength ranges that can include, in variousimplementations, red, green and blue regions of the visible spectrum,near infrared ranges (NIR, 750-1000 nm), short-wave infrared ranges(SWIR, 1-2.5 μm), mid-wave infrared ranges (MWIR, 3-5 μm), or long-waveinfrared ranges (LWIR, 8-12 μm).

When used for visible and some of the infrared wavelengths, thesecondary detectors 630A, 630B, etc. can include PN, PIN, or avalanchephotodiodes made from any suitable semiconductor material such assilicon, germanium, InGaAs, InGaAsP, or indium phosphide. When used forlonger wavelength values in the infrared range, the secondary detectors630A, 630B, etc. may include thermal detectors and/or detector elementssuch as bolometers, microbolometers, thermopiles, and optoelectronicdetectors such as quantum well infrared photodetectors (QWIPs), HgCdTephotodiodes, indium antimonide photodiodes, intersubband detectors,quantum cascade detectors, etc.

The secondary detectors 630A, 630B, etc. detectors contain singledetectors or detector arrays (e.g. CCD arrays, CMOS arrays,microbolometer arrays) made of multiple separate detector elements, andmay include integrated electronics. In some implementations, thesesecondary detectors may be integrated with filters, such as color filterarrays, to limit spectral response of individual detectors in an arrayof detectors.

The controller 640 can determine a distance to the remote target usingthe light detected by the first detector, generate a measurement of aproperty of the remote target based on the light detected by thesecondary wavelength detector 630A, and modify the generated measurementof the property of the remote target using the determined distance tothe remote target. The controller 640 may perform a similar computationfor the light detected by the third detector 630B or any other secondarydetector. For example, the controller 640 can measure the temperature ofthe target or the size of the target using the determined distance tothe target along with the light detected using the detector 630A.

In the implementation illustrated in FIG. 12, wavelength-selectiveoptical elements 660A, 660B, . . . 660N direct an input beam 612, whichincludes light scattered or emitted from the target at differentsecondary wavelengths, toward the corresponding detectors 630A, 630B, .. . 630N. In particular, the optical element 660A splits the input beam612 into a component that includes light at wavelength λ_(LASER) and acomponent that includes light at wavelength λ_(A), and directs thesecomponents toward the detectors 620 and 630A, respectively. The opticalelement 660A is disposed downrange of the optical element 660B relativeto the detectors. Accordingly, the optical element 660B splits the inputbeam 612 in a first component that includes light at wavelengthsλ_(LASER) and λ_(A), and a second component that includes light atwavelength λ_(B). The optical element 660B directs the first componenttoward the optical element 660A and the second component toward thedetector 630B. Each of these optical elements may include reflectiongratings, transmission gratings, prisms, grisms, other forms ofdiffractive and/or refractive optics as well as interference filtersand/or coatings, etc.

Each of the detectors 620, 630A, 630B, etc. has a corresponding fieldsof view (FOV) with a certain angular extent. The multispectral lidarsystem 600 can be configured to allow a target to be simultaneouslywithin the respective FOV of each detector. In other implementations,the target may be within the FOVs of different detectors at differentmoments of time, during the same ranging event or even different rangingevents.

FIGS. 13A-D illustrate several exemplary implementations of a receivercomprising primary and secondary detectors. A receiver 750 of FIG. 13Aincludes a primary detector 752 on the same plane as a secondarydetector 754. A lens 756 directs light to the detectors 752 and 754. Inthis implementation, the FOV of the primary detector 752 and the FOV ofthe secondary detector 754 may not overlap at any given moment during ascan. The relationship between these FOVs, however, is known from thegeometry and the scanning pattern of the scanner. A controller thus cancompute the time at which each of the FOVs will subtend the same target.

In general, the optics for focusing collected light onto detectors canbe refractive, such as lenses (in particular, the lens 756) and prisms,or reflective, such as mirrors. To cover a broad range of wavelengths,the refractive optics must use materials with high transmittance at allof the wavelengths of interest. BK7 and fused silica may serve asrefractive optics materials for visible light through most of SWIR. Thematerials that work well for visible light and through MWIR include CaF₂and MgF₂. ZnSe is rather transparent from NIR through LWIR, but not inthe visible range. ZnS can be a good choice when it is necessary tocover the visible spectrum through LWIR. Even for materials that aretransparent at all of the wavelengths of interest, chromatic dispersioncan lead to different focal lengths at different wavelengths. In someimplementations, the lens 756 can be replaced by multi-element optics tocompensate for chromatic dispersion. Alternatively, reflective opticsrather than the lens 756 can be used in implementations covering a widerange of wavelengths. The reflective optics can include a parabolicmirror or a system of mirrors.

The diameter of the lens can be 1 cm, 2 cm, 5 cm, or another suitablesize, for example. The distance between the plane on which the detectors752, 754 are disposed and the plane of the lens 756 can be 2 cm, 5 cm,10 cm, 20 cm or another suitable distance. This distance canapproximately correspond to the focal length of the lens 756. Thelateral spacing between the centers of neighboring detectors 752 and 754can range from tens or hundreds of microns to multiple millimeters. Whenadditional secondary detectors are disposed on the same plane as thedetectors 752 and 754, the lateral spacing does not need to beconsistent throughout the detector region. The later spacing can dependon the packaging of the detectors and the manner in which thesedetectors are integrated into the detector region. Depending on theimplementation, different detectors can be integrated on the samesubstrate, mounted as a separate semiconductor die on a shared carrier,or surface-mounted onto a printed circuit board (PCB). In at least someof the embodiments, the smallest spacing is achieved between integrateddetectors, followed by hybrid integration of die on a carrier, followedby the relatively larger spacing between packaged detectors.

In one example implementation, a die containing an array of photodiodescoated with a color filter array is placed onto a chip carrier next to adie containing an APD for detecting lidar pulses. The chip carrier isthen surface-mounted mounted onto a printed circuit board next to asurface-mounted or through-hole mounted bolometer package. The spacingbetween the photodiodes on the die containing the photodiode array canbe 50 μm, while the spacing between the center of the photodiode arrayand the center of the die containing the APD can be 400 μm. The spacingbetween the center of the packaged bolometer and the center of the APDcan be near 4 mm, due to the size of the bolometer package.

With continued reference to FIG. 13A, the lateral spacing between thedetectors 752 and 754 results in the difference between the lookdirections (centers of the IFOVs) or the FOVs. The angular difference inthe look direction can be estimated as the lateral separation divided bythe focal length. For example, the detector region with the detectors752, 754 can be separated from the lens 756 by the distance of 10 cm.The look direction of the secondary detector 754 then is approximately 4mrad or 0.23° away from the look direction of the primary detector 752.In another example implementation, the focal length is approximately 5cm, and the angular separation between the look directions of thedetectors 752, 754 accordingly increases by a factor of two.

Referring back to FIG. 2, if the arrangement illustrated in FIG. 13A isused in place of the detector 166 and the lens 196, the angulardifference between look directions and/or FOVs of the detectors 152, 154can lead to the detectors 152, 154 obtaining information from the samelook direction at different times during a scan. Additionally oralternatively, the light scattered and/or radiated from a target atdifferent wavelengths and detected by the primary detector 152(configured to detect lidar pulses) and secondary detector 154(configured to detect thermal radiation, for example) may be detected atdifferent times during a scan. These different times may correspond tothe times when each detector 152, 154 “sees” at least a part of thetarget within its FOV.

For clarity, the relationship between the physical arrangement ofdetectors and the FOVs of different detectors can be illustrated by thefollowing example. A lidar system illustrated in FIG. 5 may scan a 90°FORH and a 15° FORV in 64 horizontal scan lines with 1000 pixels 242 inevery line. Each pixel may correspond to a different look direction inthe scan. The lidar system may scan the entire field of regard in 0.1seconds at a uniform rate, so that the time interval between successivepoints in a horizontal scan is approximately 1.56 μs, while the timebetween a pixel in one horizontal line and a pixel directly above orbelow in another horizontal line is 1.56 ms. The angular separationbetween neighboring horizontal pixels may then be 0.09° while theseparation between neighboring vertical pixels may be 0.23°. In oneimplementation, a secondary detector with a horizontal look directionseparation of 2.3° from the primary lidar detector may have a 25.6 μsdelay in looking in the same direction as the primary detector. Asecondary detector with a vertical look direction separation of 0.23°from the primary lidar may have a 1.56 ms delay in looking in the samedirection as the primary detector. A lidar system may associate eachpixel from the primary lidar detector with the corresponding data fromthe secondary detector by processing the collected data along with theknown delays between the coincidence of the look directions, where thedelays are determined by the scan pattern.

In another implementation illustrated in FIG. 13B, a receiver 760includes a filter 768 that separates light signals for differentwavelengths. The filter 768 can include a dichroic mirror, a dichroicfilter, an interference filter, or a thin-film filter, constructed witha multi-layer coating to transmit or reflect different wavelength bands.Additionally or alternatively, receiver 760 can use diffractive optics,such as transmission or reflection gratings, or refractive optics, suchas prisms, to separate the light according to wavelength. Further,different kinds of optical elements can be combined in the receiver 760to achieve wavelength separation. In the implementation of FIG. 13B, thefilter 768 is placed between the detectors 762 and 764 and the commonfocusing element, a lens 766. This configuration allow detectors 762 and764 to have the same look direction (the axis at the center of theinstantaneous FOV) and overlapping FOVs at any point in time during ascan.

In the implementation of FIG. 13C, a receiver 770 includes a filter 778placed between the focusing optics 776A, 776B and the mirrors of thescanner (not shown). This implementation may allow the use of dedicatedoptics 776A, 776B for different wavelengths, which, in turn, may relaxthe design constraints for the filter 778 and the choice of materialsfor the optics 776A, 776B.

Now referring to FIG. 13D, a receiver 780 includes detectors 782, 784A,and 784B. The first detector 782 is the primary detector configured todetect the light of the emitted pulse scattered by the target. Thesecond detector 784A includes an array of detector elements. The filter788A can split the light that may be focused onto detectors 782 and 784Aby a common optical element 786A. Another filter 788B can split thelight in the collimated path from the scanning mirrors. A portion of thelight at a third wavelength may be directed by the filter 788B towardthe detector 784B. The lens 786B can focus the light at the thirdwavelength onto the detector 784B. In a sense, the implementationillustrated in FIG. 13B is a combination of the approached illustratedin FIGS. 13B and 13C.

Referring generally to FIGS. 12 and 13A-D, the spatial relationshipbetween FOVs of detectors operating in a receiver may be determined bythe fixed positioning of the detectors, the various optical componentsin the optical path of the input beam (such as the lens 756, 766, 776A,776B, 786A, 786B), and the scanner. Depending on the implementation, thescanner can be consider to provide a shared input beam with differentwavelengths to the different detectors of the receiver, or ensureregistration between input beams corresponding to the differentdetectors of the receiver. In any case, at any point in time, thescanner provides a fixed spatial relationship between the FOV of theprimary detector and the FOV of the at least one secondary detector.

Again referring generally to FIGS. 12 and 13A-D, the resolution of datagenerated using the primary detector (a primary signal corresponding tothe primary wavelength) may differ from the resolution of data generatedusing a secondary detector (a secondary signal corresponding to asecondary wavelength in a scanning lidar system). The resolution may bedefined as the number of measurements stored in the memory of acontroller for a given angular extent within the FOR. One pixel of theprimary signal may correspond to multiple pixels in a secondary signalthat cover the same angular extent in the FOR of the lidar, resulting inthe secondary signal having a higher angular resolution than the primarysignal. Conversely, a single pixel of a secondary signal may cover thesame FOV as multiple pixels of the primary signal, resulting in thesecondary signal having a lower angular resolution than the primarysignal. Generally speaking, an FOV corresponding to a pixel in a passivesignal of a scanning lidar system depends on the physical extent of thedetector for the signal as well as on the detector response orintegration time. For example, a response time of a secondary detectormay be 14 μs, while the primary lidar may obtain a new pixel every 1.56μs, resulting in one secondary signal pixel corresponding to nineprimary signal pixels.

For an active detection of a scanning system, a light source mayincrease the resolution of the signal by limiting the effective FOV foreach pixel. For the primary lidar signal, the IFOV illuminated by alaser pulse may limit the extent of the pixel. A secondary signal alsomay correspond to active detection where a certain light sourceilluminates the FOV of a secondary detector. A light source may limitthe effective FOV of the secondary pixel when the light sourceilluminates the field of view of a detector for a shorter time than theintegration or response time of the detector.

Using Secondary Optical Signals for Multispectral Sensing with Lidar

Next, FIG. 14 illustrates an example method 800 for collectingmultispectral information with a multispectral lidar. At block 810, thelidar may emit a pulse of light from a laser at the first wavelength. Atblock 820, the scanner directs the emitted pulse toward a target inaccordance with a scan pattern.

At block 830, the first, primary detector may detect a portion of theemitted pulse scattered by the remote target. The circuitry connected tothe primary detector, such as that illustrated in FIG. 11, may generatea measurement indicative of the round-trip flight time of the pulse. Atblock 840, the secondary detector may detect light scattered or emittedby the remote target, where the detected light includes the secondwavelength. As discussed above, the light scattered or emitted by theremote target may be detected over a time interval that encompasses thedetection of the lidar pulse scattered by the target, or may be detectedduring a different time interval, as determined by the physicalrelationship between the FOVs of the primary detector and the secondarydetector as well as the scan pattern. The controller may adjust theintegration time for the secondary light signal in order to achieve thedesired signal strength. In some implementations, the response time ofthe secondary detector may give a practical lower limit for the timeduration for collecting the secondary signal.

At block 850, the controller of the lidar system may determine thedistance to the target using the light detected by the primary detectorand the associated electronic components, as described above. In someimplementations, the detection of light by the primary detector also canbe used to determine the magnitude of the scattered pulse, which isindicative of the reflectivity of the target.

At block 860, the controller may generate a measurement of a property ofthe target based on the light detected by the secondary detector. Thecalculated property may be indicative of one or more of the reflectance,the physical extent (size), the shape, the texture, the velocity, atemperature of the target, etc.

In one example implementation, the signal or data obtained from thesecondary detector is used to estimate the temperature of a targetwithin the FOR. Knowledge of target temperature can improve thesituational awareness of the system in which the lidar is operating. Forexample, this data can help the vehicle controller 372 (see FIG. 9)identify humans or animals within the FOR or determine whether vehiclesin the field or regard have running engines. For the purpose ofdetecting temperature, a secondary detector may be configured to detectlight in a MWIR or a LWIR band. These infrared bands contain significantportions of radiated energy from objects at moderate temperatures (e.g.20° F., 50° F., 100° F., 200° F., 500° F.). In general, the relationshipbetween emitted energy per unit area at a given wavelength, i.e.spectral radiance, follows the Plank's equation for black bodyradiation. For a detector that collects radiation in a band ofwavelengths, the relationship between energy and temperature can becalculated by integrating the Plank's equation between two wavelengths.In practice, a calibration procedure can produce a look-up table for therelationship between signal magnitude and temperature of a black bodyfor a given detector configuration.

A target may have an emissivity less than that of a black body,resulting in a lower signal for a given temperature. Estimating theemissivity of a target may help to obtain a more accurate estimate ofthe temperature of the target. For many opaque targets, the emissivity,E, can be estimated as E=1−r, where r is the reflectivity of a target.The reflectivity of a target at the wavelength of the laser of the lidar(primary wavelength) may serve as the estimate of reflectivity at thewavelength used by a secondary detector for temperature measurement.Thus, calculating the reflectivity of a target at the primary wavelengthmay help to determine the temperature of the target with better accuracythan assuming that the target radiates as a black body.

The controller of a multispectral lidar system, or another controllersuch as the vehicle controller 372 of FIG. 9, may be configured todetermine a reflectivity of the target upon determining the distance tothe target and the magnitude of a returned pulse. In one implementation,a receiver may estimate the magnitude of a returned pulse using timinginformation as illustrated in FIG. 15. As illustrated in this example,four timing values may be detected for a return pulse 920. When therising edge of the return pulse 920 reaches a threshold level 931, thereceiver records time t_(1r). When the rising edge of the pulse 920reaches a higher threshold 932, the receiver records time t_(2r).Falling edge times t_(1f) and t_(2f) represent the times when thefalling edge of the pulse 920 descends to the thresholds 932 and 931,respectively. The time difference between t_(2r) and t_(2f) as well asthe time difference between t_(1r) and t_(1f) can indicate the magnitudeof the returned pulse. For comparison, a higher magnitude return pulse921 has larger time differences between same levels on the rising andthe falling edges than the lower magnitude pulse 920. Moreover, the peakvalue of a pulse may be proportional to time differences between equallevel points on the rising and the falling edges for linear detectors.In another implementation, only one threshold level is required toestimate the magnitude of a pulse. In other implementations, additionallevels can increase the accuracy of the estimation of magnitude usingadditional circuitry in the receiver.

FIG. 16 illustrates an example method 850 by which the controller of amultispectral lidar system may estimate the temperature of the target.At block 952, the receiver obtains timing values that correspond to thereturned pulse, as illustrated in FIG. 15. Each of the timing values maybe obtained by a TDC configured to detect when a rising edge or afalling edge crosses a preset threshold. At block 954, the controllermay compute the distance to the target as half the product of the speedof light and the delay of the return pulse with respect to the emittedpulse. The controller may use both the rising and falling edge delaysfor the computation to minimize the dependence of computed distance onthe magnitude of the returned pulse, known as the range-walk problem. Atblock 956, the controller may determine the magnitude of the returnpulse from the multiple timing values. At this step the magnitude may bein arbitrary units that are consistent from one measurement to the next.

At block 958, the controller may determine or estimate the reflectivityof the target from the distance to the target and the magnitude of thereturn pulse. The determination or estimation may also take into accountthe orientation of the target relative to the lidar beam. Theorientation angle may be estimated from the change of distance withrespect to position within the field of regard at the current positionwithin the field of regard. The estimation of the orientation anglerequires knowing the distances at the neighboring positions within thefield of regard and can use the data from the current scan or from aprevious scan, depending on the implementation. In some cases, a normalincidence angle may be assumed in cases when a better estimation is notavailable. Using an incidence angle given by θ, the reflectivity of thetarget may be estimated as

$r = \frac{M\; D^{2}}{M_{ref}D_{ref}^{2}\cos\;\theta}$where M is the magnitude of the return pulse, D is the distance to thetarget, θ is the estimated orientation angle of the target and M_(ref)is the magnitude of the reference pulse returned from a referenceunit-reflectivity target at the reference distance D_(ref).

Also at block 958, the system may calculate the emissivity of the targetfrom the reflectivity of the target as E=1−r. In other implementationsemissivities of different target may be stored in a table, and thereflectivity of the target may be used as one of the factors that allowstarget classification and a subsequent look-up of its emissivity at thesecond wavelength which is used for temperature estimation. At block960, the receiver uses a secondary detector to detect the magnitude of alight signal including the second wavelength in the LWIR region. In adifferent implementation, the secondary detector may detect a signal inthe MWIR band in order to estimate temperature. A controller of lidarthe system ensures that the detected secondary signal is from the sameposition in the field of regard as the primary lidar signal. In someimplementations, the resolution of the data obtained by the seconddetector such as an LWIR detector may be smaller than the resolution ofthe data obtained by the first detector that detects the return pulses.In such implementations, the higher resolution primary data may be usedby the system to identify the size of an object that can be assumed tobe at the same temperature. The primary data can, with signalprocessing, improve the resolution of secondary thermal data.

At block 962, the system may estimate the temperature of the target bymodifying the measurement generated at block 960, i.e. the detectedmagnitude of the LWIR emission. To do so, the LWIR magnitude detected bythe system at block 962 may be normalized or divided by the estimatedemissivity of the target (from block 960) before looking up thetemperature corresponding to the measurement, T(M_(LWIR,meas)/E) from alook up table, T(M_(LWIR,ref)). The look-up table T(M_(LWIR,ref)) maystore temperature as a function of detected LWIR magnitude generated bya calibration procedure using a black-body target. The table also may bebased on the calculation of a black-body radiation curve and opticalproperties of the LWIR detector (at least in part). In someimplementations, additional corrections may be applied to the detectedmagnitude in order to account for atmospheric loss, reflection ofbackground radiation by the target, or transmission of the target.

In other implementations, a secondary detector may be configured tocollect light in the visible region of the spectrum, such as red light,green light, or blue light. A secondary detector also may includeseparate sensors for red, green, and blue light that can simultaneouslydetect different color light signals. Furthermore, a secondary detectormay include a sensor (or detector) array that can be a monochromaticsensor array or a three-color sensor array. A sensor or detector arraymay comprise identical detector elements.

A multispectral lidar system may use an array detector to record animage encompassing the FOV of the light source at a certain positionwithin the FOR. As illustrated in FIG. 17, each sensor or detectorelement of the array in a secondary detector may have a smaller field ofview 1010AA through 1010HH that is smaller than the IFOV 1012 of thelight source, resulting in higher-resolution secondary data. Asindicated above, this higher-resolution secondary data may improveobject identification and the situational awareness of the platform onwhich the multispectral lidar system operates. For example, using theprimary detector, a multispectral lidar system may identify a smalltarget, while the secondary detector may collect information at a higherdensity. The multispectral lidar system may store the higher-densityinformation only for the positions in the FOR that correspond to targetsof interest. For example, the primary data may correspond to a pointcloud that contains several detected return pulses from a foregrounddistance that might correspond to a road sign or a small obstacle. Themultispectral lidar system may implement a suitable computational engineor send the corresponding higher-density secondary data to the vehiclecontroller 372 (see FIG. 9) for processing, so as to identify the roadsign or the obstacle. This implementation may help to identify objectsusing fewer computational resources relative to the approach that relieson using lidar information in conjunction with separate high-resolutionimaging of the FOR, for example.

Additionally or alternatively, the higher-density secondary data maycontain information about the spatial extent (size) of a target witharbitrary scale. For example, an image of an insect that is close to thelidar may occupy as many detector elements in an array sensor as animage of a large bird that is farther from the lidar. One or moreprimary data points corresponding to the insect or the bird, asdescribed in the example above, may allow a determination of distance tothe target, and modification of the image of the target obtained usingthe secondary detector may allow quantifying the physical scale of thetarget.

In some implementations, a multispectral lidar system may use asecondary light source to illuminate the FOV of the secondary detector.In this sense, both the primary detector and the secondary datacorrespond to active sensing. For example, a certain multispectral lidarsystem may operate as a night-vision system that uses the primarydetector to identify targets of interest, simultaneously illuminatestargets with a NIR light source, such as a laser, and collects thehigher-density information with a NIR array sensor. This implementationallows an energy-efficient use of the secondary light source toilluminate targets of interest and saves computational resources bylimiting the processing of image information to specific targets.

General Considerations

In some cases, a computing device may be used to implement variousmodules, circuits, systems, methods, or algorithm steps disclosedherein. As an example, all or part of a module, circuit, system, method,or algorithm disclosed herein may be implemented or performed by ageneral-purpose single- or multi-chip processor, a digital signalprocessor (DSP), an ASIC, a FPGA, any other suitable programmable-logicdevice, discrete gate or transistor logic, discrete hardware components,or any suitable combination thereof. A general-purpose processor may bea microprocessor, or, any conventional processor, controller,microcontroller, or state machine. A processor may also be implementedas a combination of computing devices, e.g., a combination of a DSP anda microprocessor, a plurality of microprocessors, one or moremicroprocessors in conjunction with a DSP core, or any other suchconfiguration.

In particular embodiments, one or more implementations of the subjectmatter described herein may be implemented as one or more computerprograms (e.g., one or more modules of computer-program instructionsencoded or stored on a computer-readable non-transitory storage medium).As an example, the steps of a method or algorithm disclosed herein maybe implemented in a processor-executable software module which mayreside on a computer-readable non-transitory storage medium. Inparticular embodiments, a computer-readable non-transitory storagemedium may include any suitable storage medium that may be used to storeor transfer computer software and that may be accessed by a computersystem. Herein, a computer-readable non-transitory storage medium ormedia may include one or more semiconductor-based or other integratedcircuits (ICs) (such, as for example, field-programmable gate arrays(FPGAs) or application-specific ICs (ASICs)), hard disk drives (HDDs),hybrid hard drives (HHDs), optical discs (e.g., compact discs (CDs),CD-ROM, digital versatile discs (DVDs), blue-ray discs, or laser discs),optical disc drives (ODDs), magneto-optical discs, magneto-opticaldrives, floppy diskettes, floppy disk drives (FDDs), magnetic tapes,flash memories, solid-state drives (SSDs), RAM, RAM-drives, ROM, SECUREDIGITAL cards or drives, any other suitable computer-readablenon-transitory storage media, or any suitable combination of two or moreof these, where appropriate. A computer-readable non-transitory storagemedium may be volatile, non-volatile, or a combination of volatile andnon-volatile, where appropriate.

In some cases, certain features described herein in the context ofseparate implementations may also be combined and implemented in asingle implementation. Conversely, various features that are describedin the context of a single implementation may also be implemented inmultiple implementations separately or in any suitable sub-combination.Moreover, although features may be described above as acting in certaincombinations and even initially claimed as such, one or more featuresfrom a claimed combination may in some cases be excised from thecombination, and the claimed combination may be directed to asub-combination or variation of a sub-combination.

While operations may be depicted in the drawings as occurring in aparticular order, this should not be understood as requiring that suchoperations be performed in the particular order shown or in sequentialorder, or that all operations be performed. Further, the drawings mayschematically depict one more example processes or methods in the formof a flow diagram or a sequence diagram. However, other operations thatare not depicted may be incorporated in the example processes or methodsthat are schematically illustrated. For example, one or more additionaloperations may be performed before, after, simultaneously with, orbetween any of the illustrated operations. Moreover, one or moreoperations depicted in a diagram may be repeated, where appropriate.Additionally, operations depicted in a diagram may be performed in anysuitable order. Furthermore, although particular components, devices, orsystems are described herein as carrying out particular operations, anysuitable combination of any suitable components, devices, or systems maybe used to carry out any suitable operation or combination ofoperations. In certain circumstances, multitasking or parallelprocessing operations may be performed. Moreover, the separation ofvarious system components in the implementations described herein shouldnot be understood as requiring such separation in all implementations,and it should be understood that the described program components andsystems may be integrated together in a single software product orpackaged into multiple software products.

Various implementations have been described in connection with theaccompanying drawings. However, it should be understood that the figuresmay not necessarily be drawn to scale. As an example, distances orangles depicted in the figures are illustrative and may not necessarilybear an exact relationship to actual dimensions or layout of the devicesillustrated.

The scope of this disclosure encompasses all changes, substitutions,variations, alterations, and modifications to the example embodimentsdescribed or illustrated herein that a person having ordinary skill inthe art would comprehend. The scope of this disclosure is not limited tothe example embodiments described or illustrated herein. Moreover,although this disclosure describes or illustrates respective embodimentsherein as including particular components, elements, functions,operations, or steps, any of these embodiments may include anycombination or permutation of any of the components, elements,functions, operations, or steps described or illustrated anywhere hereinthat a person having ordinary skill in the art would comprehend.

The term “or” as used herein is to be interpreted as an inclusive ormeaning any one or any combination, unless expressly indicated otherwiseor indicated otherwise by context. Therefore, herein, the expression “Aor B” means “A, B, or both A and B.” As another example, herein, “A, Bor C” means at least one of the following: A; B; C; A and B; A and C; Band C; A, B and C. An exception to this definition will occur if acombination of elements, devices, steps, or operations is in some wayinherently mutually exclusive.

As used herein, words of approximation such as, without limitation,“approximately, “substantially,” or “about” refer to a condition thatwhen so modified is understood to not necessarily be absolute or perfectbut would be considered close enough to those of ordinary skill in theart to warrant designating the condition as being present. The extent towhich the description may vary will depend on how great a change can beinstituted and still have one of ordinary skill in the art recognize themodified feature as having the required characteristics or capabilitiesof the unmodified feature. In general, but subject to the precedingdiscussion, a numerical value herein that is modified by a word ofapproximation such as “approximately” may vary from the stated value by±0.5%, ±1%, ±2%, ±3%, ±4%, ±5%, ±10%, ±12%, or ±15%.

As used herein, the terms “first,” “second,” “third,” etc. may be usedas labels for nouns that they precede, and these terms may notnecessarily imply a particular ordering (e.g., a particular spatial,temporal, or logical ordering). As an example, a system may be describedas determining a “first result” and a “second result,” and the terms“first” and “second” may not necessarily imply that the first result isdetermined before the second result.

As used herein, the terms “based on” and “based at least in part on” maybe used to describe or present one or more factors that affect adetermination, and these terms may not exclude additional factors thatmay affect a determination. A determination may be based solely on thosefactors which are presented or may be based at least in part on thosefactors. The phrase “determine A based on B” indicates that B is afactor that affects the determination of A. In some instances, otherfactors may also contribute to the determination of A. In otherinstances, A may be determined based solely on B.

What is claimed is:
 1. A multispectral lidar system comprising: a laserconfigured to emit a pulse of light including a first wavelength; ascanner configured to direct the emitted pulse of light in accordancewith a scan pattern; a receiver including: a first detector configuredto detect, over a first angular region defining a first detector fieldof view (FOV), the emitted pulse of light scattered by a remote target,and a second detector configured to detect, over a second angular regiondefining a second detector FOV, light scattered or emitted by the remotetarget and including a second wavelength, wherein the scanner provides,at any point in time, a fixed spatial relationship between the firstdetector FOV and the second detector FOV; the lidar system furthercomprising: a controller configured to (i) determine a distance to theremote target using the light detected by the first detector, (ii)generate a measurement of a property of the remote target based on thelight detected by the second detector, and (iii) modify the generatedmeasurement of the property of the remote target using the determineddistance to the remote target.
 2. The multispectral lidar system ofclaim 1, wherein the measurement of the property generated by thecontroller indicates a temperature of the remote target.
 3. Themultispectral lidar system of claim 2, wherein the second detectorincludes one or more thermal detector elements.
 4. The multispectrallidar system of claim 2, wherein the second wavelength is one of (i) amid-wave infrared or (ii) a long-wave infrared region.
 5. Themultispectral lidar system of claim 1, wherein the controller is furtherconfigured to (i) determine a reflectivity and/or an emissivity of theremote target using the light detected by the first detector, and (ii)modify the generated measurement of the property of the remote targetusing the determined reflectivity and/or emissivity.
 6. Themultispectral lidar system of claim 5, wherein the generated measurementincludes a magnitude of the light in an infrared region emitted by theremote target and detected by the second detector, and wherein thecontroller is configured to (i) determine the emissivity of the remotetarget using the light detected by the first detector, and (ii)determine a temperature of the remote target using the determinedemissivity and the magnitude of the light in the infrared region.
 7. Themultispectral lidar system of claim 1, wherein the controller is furtherconfigured to (i) determine a plurality of distances to points on asurface on the remote target using a plurality of respective pulses oflight emitted by the laser and detected by the first detector, (ii)determine an orientation of the surface of the target relative to themultispectral lidar system using the determined plurality of distances,and (iii) modify the generated measurement of the property of the remotetarget using the determined orientation of the surface of the target. 8.The multispectral lidar system of claim 1, wherein the controller isconfigured to (i) generate, using the light detected by the firstdetector, first data having a first angular resolution, and (ii)generate, using the light detected by the second detector, second datahaving a second angular resolution, wherein the first angular resolutionis larger than the second angular resolution.
 9. The multispectral lidarsystem of claim 1, wherein the controller is configured to (i) generate,using the light detected by the first detector, first data having afirst angular resolution, and (ii) generate, using the light detected bythe second detector, second data having a second angular resolution,wherein the first angular resolution is smaller than the second angularresolution.
 10. The multispectral lidar system of claim 1, furthercomprising: an optical filtering element configured to (i) receive inputlight from the scanner, (ii) split the received input light into (i) afirst component including the first wavelength and substantially free ofthe second wavelength, and (ii) a second component including the secondwavelength and substantially free of the first wavelength, and (iii)direct the first component and the second component toward the firstdetector and the second detector, respectively.
 11. The multispectrallidar system of claim 10, wherein the optical filtering element includesone of a reflection grating, a transmission grating, a prism, a grism,and interference filter, or a coating applied to a lens.
 12. Themultispectral lidar system of claim 1, wherein: the first detector andthe second detector are disposed on a same detector plane, the firstdetector is positioned on the detector plane to detect the emitted pulseof light scattered by the remote target, when the remote target iswithin a maximum range of the multispectral lidar system, and the seconddetector is positioned on the detector plane so that the emitted pulseof light scattered by the remote target is outside the second detectorFOV.
 13. The multispectral lidar system of claim 1, wherein the seconddetector includes a detector array made up of a plurality of identicaldetector elements.
 14. The lidar system of claim 1, further comprising asecond light source configured to emit light including the secondwavelength, wherein the light detected by the second detector includesthe light emitted by the second light source and scattered by the remotetarget.
 15. A method in a multispectral lidar system for multispectralscanning, the method comprising: emitting a pulse of light including afirst wavelength; directing the generated pulse of light in accordancewith a scan pattern; detecting the emitted pulse of light pulse of lightscattered by a remote target, over a first angular region defining afirst field of view (FOV); detecting light scattered or emitted by theremote target and including a second wavelength, over a second angularregion defining a second FOV, wherein the first FOV and the second FOVhave a fixed spatial relationship in accordance with the scan pattern;determining a distance to the remote target using the light detectedover the first FOV; generating a measurement of a property of the remotetarget based on the light detected over the second FOV; and modifyingthe generated measurement of the property of the remote target using thedetermined distance to the remote target.
 16. The method of claim 15,wherein generating the measurement of the property of the remote targetincludes generating a measurement of a temperature of the remote target.17. The method of claim 16, wherein detecting the light including thesecond wavelength includes using one or more thermal detector elements.18. The method of claim 16, wherein the second wavelength is one of (i)a mid-wave infrared or (ii) a long-wave infrared region.
 19. The methodof claim 15, further comprising: determining a reflectivity and/or anemissivity of the remote target using the detected light that includesthe first wavelength; and modifying the generated measurement of theproperty of the remote target using the determined reflectivity and/oremissivity.
 20. The method of claim 15, wherein the generatedmeasurement includes a magnitude of the light in an infrared regionemitted by the remote target and detected over the second FOV, themethod further comprising: determining the emissivity of the remotetarget using the light detected over the first FOV; and determining atemperature of the remote target using the determined emissivity and themagnitude of the light in the infrared region.
 21. The method of claim20, wherein determining the temperature of the remote target using thedetermined emissivity and the magnitude of the light in the infraredregion includes using a look-up table.
 22. The method of claim 15,further comprising: determining a plurality of distances to points on asurface on the remote target using a plurality of respective pulses oflight emitted with the first wavelength and detected over the first FOV;determining an orientation of the surface of the target relative to themultispectral lidar system using the determined plurality of distances;and modifying the generated measurement of the property of the remotetarget using the determined orientation of the surface of the target.23. The method of claim 15, further comprising: generating, using thelight detected over the first FOV, first data having a first angularresolution; and generating, using the light detected over the secondFOV, second data having a second angular resolution, wherein the firstangular resolution is larger than the second angular resolution.
 24. Themethod of claim 15, further comprising: generating, using the lightdetected over the first FOV, first data having a first angularresolution; and generating, using the light detected over the secondFOV, second data having a second angular resolution, wherein the firstangular resolution is smaller than the second angular resolution. 25.The method of claim 15, further comprising emitting light including thesecond wavelength, wherein the light detected over the second FOVincludes the emitted light with the second wavelength and scattered bythe remote target.